/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:28:13.919: Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:23:13.875: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should support remote command execution over websockets [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:23:13.896: INFO: >>> kubeConfig: /root/.kube/config STEP: creating the pod STEP: submitting the pod to kubernetes May 7 21:28:13.919: FAIL: Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc003489cc0, 0xc004cfa800, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func18.7() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:560 +0x48c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0036d6300, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-3139". STEP: Found 9 events. May 7 21:28:13.923: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468: { } Scheduled: Successfully assigned pods-3139/pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468 to node1 May 7 21:28:13.923: INFO: At 2021-05-07 21:23:15 +0000 UTC - event for pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468: {multus } AddedInterface: Add eth0 [10.244.3.94/24] May 7 21:28:13.923: INFO: At 2021-05-07 21:23:15 +0000 UTC - event for pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 7 21:28:13.923: INFO: At 2021-05-07 21:23:16 +0000 UTC - event for pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:28:13.923: INFO: At 2021-05-07 21:23:16 +0000 UTC - event for pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468: {kubelet node1} Failed: Error: ErrImagePull May 7 21:28:13.923: INFO: At 2021-05-07 21:23:17 +0000 UTC - event for pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 7 21:28:13.923: INFO: At 2021-05-07 21:23:19 +0000 UTC - event for pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468: {multus } AddedInterface: Add eth0 [10.244.3.95/24] May 7 21:28:13.923: INFO: At 2021-05-07 21:23:19 +0000 UTC - event for pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 7 21:28:13.923: INFO: At 2021-05-07 21:23:19 +0000 UTC - event for pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:28:13.926: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:28:13.926: INFO: pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:23:13 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:23:13 +0000 UTC ContainersNotReady containers with unready status: [main]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:23:13 +0000 UTC ContainersNotReady containers with unready status: [main]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:23:13 +0000 UTC }] May 7 21:28:13.926: INFO: May 7 21:28:13.930: INFO: Logging node info for node master1 May 7 21:28:13.932: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 30614 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:05 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:05 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:05 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:28:05 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:28:13.933: INFO: Logging kubelet events for node master1 May 7 21:28:13.936: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:28:13.947: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.947: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:28:13.947: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:28:13.947: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:28:13.947: INFO: Container node-exporter ready: true, restart count 0 May 7 21:28:13.947: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.947: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:28:13.947: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.947: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:28:13.947: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.947: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:28:13.947: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:28:13.947: INFO: Init container install-cni ready: true, restart count 0 May 7 21:28:13.947: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:28:13.947: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.947: INFO: Container coredns ready: true, restart count 2 May 7 21:28:13.947: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.947: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:28:13.947: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.947: INFO: Container kube-multus ready: true, restart count 1 May 7 21:28:13.947: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:28:13.947: INFO: Container docker-registry ready: true, restart count 0 May 7 21:28:13.947: INFO: Container nginx ready: true, restart count 0 May 7 21:28:13.947: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:28:13.947: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:28:13.947: INFO: Container prometheus-operator ready: true, restart count 0 W0507 21:28:13.960288 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:28:13.985: INFO: Latency metrics for node master1 May 7 21:28:13.985: INFO: Logging node info for node master2 May 7 21:28:13.988: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 30675 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:12 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:12 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:12 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:28:12 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:28:13.988: INFO: Logging kubelet events for node master2 May 7 21:28:13.990: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:28:13.998: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.998: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:28:13.998: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.998: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:28:13.998: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.998: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:28:13.998: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.998: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:28:13.998: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:28:13.998: INFO: Init container install-cni ready: true, restart count 0 May 7 21:28:13.998: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:28:13.998: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.998: INFO: Container kube-multus ready: true, restart count 1 May 7 21:28:13.998: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:28:13.998: INFO: Container autoscaler ready: true, restart count 2 May 7 21:28:13.998: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:28:13.998: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:28:13.998: INFO: Container node-exporter ready: true, restart count 0 W0507 21:28:14.011380 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:28:14.040: INFO: Latency metrics for node master2 May 7 21:28:14.040: INFO: Logging node info for node master3 May 7 21:28:14.043: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 30674 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:11 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:11 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:11 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:28:11 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:28:14.043: INFO: Logging kubelet events for node master3 May 7 21:28:14.045: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:28:14.053: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.053: INFO: Container kube-multus ready: true, restart count 1 May 7 21:28:14.053: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.053: INFO: Container coredns ready: true, restart count 2 May 7 21:28:14.053: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:28:14.053: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:28:14.053: INFO: Container node-exporter ready: true, restart count 0 May 7 21:28:14.053: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.053: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:28:14.053: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.053: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:28:14.053: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.053: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:28:14.053: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.053: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:28:14.053: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:28:14.053: INFO: Init container install-cni ready: true, restart count 1 May 7 21:28:14.053: INFO: Container kube-flannel ready: true, restart count 2 W0507 21:28:14.066351 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:28:14.096: INFO: Latency metrics for node master3 May 7 21:28:14.096: INFO: Logging node info for node node1 May 7 21:28:14.100: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 30659 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:11 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:11 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:11 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:28:11 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:28:14.100: INFO: Logging kubelet events for node node1 May 7 21:28:14.103: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:28:14.118: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:28:14.118: INFO: Container nodereport ready: true, restart count 0 May 7 21:28:14.118: INFO: Container reconcile ready: true, restart count 0 May 7 21:28:14.118: INFO: fail-once-local-xq6h7 started at 2021-05-07 21:26:12 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.118: INFO: Container c ready: false, restart count 0 May 7 21:28:14.118: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.118: INFO: Container kube-multus ready: true, restart count 1 May 7 21:28:14.118: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:28:14.118: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:28:14.118: INFO: Container grafana ready: true, restart count 0 May 7 21:28:14.118: INFO: Container prometheus ready: true, restart count 1 May 7 21:28:14.118: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:28:14.118: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 7 21:28:14.118: INFO: fail-once-local-5m46c started at 2021-05-07 21:26:12 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.118: INFO: Container c ready: false, restart count 0 May 7 21:28:14.118: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:28:14.119: INFO: Init container install-cni ready: true, restart count 2 May 7 21:28:14.119: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:28:14.119: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.119: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:28:14.119: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.119: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:28:14.119: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.119: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:28:14.119: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:28:14.119: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:28:14.119: INFO: Container node-exporter ready: true, restart count 0 May 7 21:28:14.119: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:28:14.119: INFO: Container collectd ready: true, restart count 0 May 7 21:28:14.119: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:28:14.119: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:28:14.119: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.119: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:28:14.119: INFO: client-envvars-6eebb421-3a32-419b-b48d-220c4773da42 started at 2021-05-07 21:25:48 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.119: INFO: Container env3cont ready: false, restart count 0 May 7 21:28:14.119: INFO: server-envvars-e2816f49-41f1-428a-9e96-293b2452238b started at 2021-05-07 21:20:35 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.119: INFO: Container srv ready: true, restart count 0 May 7 21:28:14.119: INFO: affinity-clusterip-transition-kf9k7 started at 2021-05-07 21:27:58 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.119: INFO: Container affinity-clusterip-transition ready: true, restart count 0 May 7 21:28:14.119: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.119: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:28:14.119: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:28:14.119: INFO: Container discover ready: false, restart count 0 May 7 21:28:14.119: INFO: Container init ready: false, restart count 0 May 7 21:28:14.119: INFO: Container install ready: false, restart count 0 May 7 21:28:14.119: INFO: pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468 started at 2021-05-07 21:23:13 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.119: INFO: Container main ready: false, restart count 0 W0507 21:28:14.133792 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:28:14.164: INFO: Latency metrics for node node1 May 7 21:28:14.164: INFO: Logging node info for node node2 May 7 21:28:14.167: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 30645 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:08 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:08 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:28:08 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:28:08 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:28:14.167: INFO: Logging kubelet events for node node2 May 7 21:28:14.169: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:28:14.182: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:28:14.183: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:28:14.183: INFO: Container discover ready: false, restart count 0 May 7 21:28:14.183: INFO: Container init ready: false, restart count 0 May 7 21:28:14.183: INFO: Container install ready: false, restart count 0 May 7 21:28:14.183: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:28:14.183: INFO: Container nodereport ready: true, restart count 0 May 7 21:28:14.183: INFO: Container reconcile ready: true, restart count 0 May 7 21:28:14.183: INFO: var-expansion-57d7e0be-4edf-4c50-ae38-6263f6e1c41a started at 2021-05-07 21:26:51 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container dapi-container ready: false, restart count 0 May 7 21:28:14.183: INFO: ss2-0 started at 2021-05-07 21:27:49 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container webserver ready: false, restart count 0 May 7 21:28:14.183: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:28:14.183: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:28:14.183: INFO: Container collectd ready: true, restart count 0 May 7 21:28:14.183: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:28:14.183: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:28:14.183: INFO: downward-api-f0dc82d8-62a1-4f8e-94bb-e4c2ec7730b4 started at 2021-05-07 21:26:15 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container dapi-container ready: false, restart count 0 May 7 21:28:14.183: INFO: busybox-scheduling-a81d0bf6-eebf-4742-a81c-806e1671592b started at 2021-05-07 21:27:25 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container busybox-scheduling-a81d0bf6-eebf-4742-a81c-806e1671592b ready: false, restart count 0 May 7 21:28:14.183: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:28:14.183: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:28:14.183: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:28:14.183: INFO: test-rollover-controller-9qhvg started at 2021-05-07 21:25:56 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container httpd ready: false, restart count 0 May 7 21:28:14.183: INFO: affinity-clusterip-transition-qdtd6 started at 2021-05-07 21:27:58 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container affinity-clusterip-transition ready: true, restart count 0 May 7 21:28:14.183: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:28:14.183: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:28:14.183: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:28:14.183: INFO: Container node-exporter ready: true, restart count 0 May 7 21:28:14.183: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:28:14.183: INFO: Init container install-cni ready: true, restart count 2 May 7 21:28:14.183: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:28:14.183: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container kube-multus ready: true, restart count 1 May 7 21:28:14.183: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:28:14.183: INFO: Container tas-controller ready: true, restart count 0 May 7 21:28:14.183: INFO: Container tas-extender ready: true, restart count 0 May 7 21:28:14.183: INFO: var-expansion-f8e66cd5-ac10-4746-a81c-465a4b6408ff started at 2021-05-07 21:26:00 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container dapi-container ready: false, restart count 0 May 7 21:28:14.183: INFO: affinity-clusterip-transition-lbp7s started at 2021-05-07 21:27:58 +0000 UTC (0+1 container statuses recorded) May 7 21:28:14.183: INFO: Container affinity-clusterip-transition ready: true, restart count 0 W0507 21:28:14.195613 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:28:14.225: INFO: Latency metrics for node node2 May 7 21:28:14.225: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-3139" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:30:28.204: Unexpected error: <*errors.errorString | 0xc003686430>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31234 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31234 over TCP protocol occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1242 [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:28:18.415: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to create a functioning NodePort service [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service nodeport-test with type=NodePort in namespace services-2705 STEP: creating replication controller nodeport-test in namespace services-2705 I0507 21:28:18.449739 38 runners.go:190] Created replication controller with name: nodeport-test, namespace: services-2705, replica count: 2 I0507 21:28:21.500340 38 runners.go:190] nodeport-test Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady May 7 21:28:21.500: INFO: Creating new exec pod May 7 21:28:26.525: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 nodeport-test 80' May 7 21:28:27.165: INFO: stderr: "+ nc -zv -t -w 2 nodeport-test 80\nConnection to nodeport-test 80 port [tcp/http] succeeded!\n" May 7 21:28:27.165: INFO: stdout: "" May 7 21:28:27.166: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.233.26.186 80' May 7 21:28:27.418: INFO: stderr: "+ nc -zv -t -w 2 10.233.26.186 80\nConnection to 10.233.26.186 80 port [tcp/http] succeeded!\n" May 7 21:28:27.418: INFO: stdout: "" May 7 21:28:27.418: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:27.665: INFO: rc: 1 May 7 21:28:27.665: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:28.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:29.044: INFO: rc: 1 May 7 21:28:29.044: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:29.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:29.926: INFO: rc: 1 May 7 21:28:29.926: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:30.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:30.923: INFO: rc: 1 May 7 21:28:30.923: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:31.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:31.935: INFO: rc: 1 May 7 21:28:31.935: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:32.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:32.922: INFO: rc: 1 May 7 21:28:32.922: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:33.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:33.929: INFO: rc: 1 May 7 21:28:33.929: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:34.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:34.921: INFO: rc: 1 May 7 21:28:34.921: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:35.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:35.949: INFO: rc: 1 May 7 21:28:35.949: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:36.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:37.273: INFO: rc: 1 May 7 21:28:37.273: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:37.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:37.954: INFO: rc: 1 May 7 21:28:37.954: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:38.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:38.923: INFO: rc: 1 May 7 21:28:38.923: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:39.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:39.935: INFO: rc: 1 May 7 21:28:39.935: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:40.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:40.942: INFO: rc: 1 May 7 21:28:40.942: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:41.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:41.923: INFO: rc: 1 May 7 21:28:41.923: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:42.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:42.915: INFO: rc: 1 May 7 21:28:42.915: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:43.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:43.932: INFO: rc: 1 May 7 21:28:43.932: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:44.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:44.920: INFO: rc: 1 May 7 21:28:44.920: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:45.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:45.925: INFO: rc: 1 May 7 21:28:45.925: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:46.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:46.938: INFO: rc: 1 May 7 21:28:46.938: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:47.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:47.950: INFO: rc: 1 May 7 21:28:47.950: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:48.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:48.941: INFO: rc: 1 May 7 21:28:48.941: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:49.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:49.936: INFO: rc: 1 May 7 21:28:49.936: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:50.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:50.924: INFO: rc: 1 May 7 21:28:50.924: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:51.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:51.961: INFO: rc: 1 May 7 21:28:51.961: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:52.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:52.931: INFO: rc: 1 May 7 21:28:52.931: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:53.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:53.937: INFO: rc: 1 May 7 21:28:53.937: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:54.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:54.935: INFO: rc: 1 May 7 21:28:54.935: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:55.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:55.915: INFO: rc: 1 May 7 21:28:55.916: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:56.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:56.943: INFO: rc: 1 May 7 21:28:56.943: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:57.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:57.951: INFO: rc: 1 May 7 21:28:57.952: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:58.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:58.926: INFO: rc: 1 May 7 21:28:58.926: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:28:59.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:28:59.945: INFO: rc: 1 May 7 21:28:59.945: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:00.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:00.919: INFO: rc: 1 May 7 21:29:00.919: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:01.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:01.928: INFO: rc: 1 May 7 21:29:01.928: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:02.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:02.919: INFO: rc: 1 May 7 21:29:02.919: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:03.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:03.943: INFO: rc: 1 May 7 21:29:03.943: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:04.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:04.920: INFO: rc: 1 May 7 21:29:04.920: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:05.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:05.926: INFO: rc: 1 May 7 21:29:05.926: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:06.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:07.259: INFO: rc: 1 May 7 21:29:07.260: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:07.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:07.939: INFO: rc: 1 May 7 21:29:07.939: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:08.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:08.920: INFO: rc: 1 May 7 21:29:08.920: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:09.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:09.918: INFO: rc: 1 May 7 21:29:09.918: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:10.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:10.938: INFO: rc: 1 May 7 21:29:10.938: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:11.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:11.923: INFO: rc: 1 May 7 21:29:11.923: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:12.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:12.940: INFO: rc: 1 May 7 21:29:12.940: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:13.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:13.934: INFO: rc: 1 May 7 21:29:13.934: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:14.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:14.914: INFO: rc: 1 May 7 21:29:14.914: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:15.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:15.921: INFO: rc: 1 May 7 21:29:15.921: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:16.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:16.951: INFO: rc: 1 May 7 21:29:16.951: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:17.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:17.925: INFO: rc: 1 May 7 21:29:17.925: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:18.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:18.915: INFO: rc: 1 May 7 21:29:18.915: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:19.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:19.926: INFO: rc: 1 May 7 21:29:19.926: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:20.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:20.941: INFO: rc: 1 May 7 21:29:20.941: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:21.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:21.927: INFO: rc: 1 May 7 21:29:21.927: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:22.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:22.942: INFO: rc: 1 May 7 21:29:22.943: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:23.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:23.944: INFO: rc: 1 May 7 21:29:23.944: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:24.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:24.924: INFO: rc: 1 May 7 21:29:24.924: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:25.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:25.928: INFO: rc: 1 May 7 21:29:25.928: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:26.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:26.948: INFO: rc: 1 May 7 21:29:26.948: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:27.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:27.928: INFO: rc: 1 May 7 21:29:27.928: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:28.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:28.924: INFO: rc: 1 May 7 21:29:28.924: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:29.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:29.933: INFO: rc: 1 May 7 21:29:29.933: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:30.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:30.942: INFO: rc: 1 May 7 21:29:30.942: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:31.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:31.929: INFO: rc: 1 May 7 21:29:31.929: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:32.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:32.944: INFO: rc: 1 May 7 21:29:32.944: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:33.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:33.934: INFO: rc: 1 May 7 21:29:33.934: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:34.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:34.912: INFO: rc: 1 May 7 21:29:34.912: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:35.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:35.932: INFO: rc: 1 May 7 21:29:35.933: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:36.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:37.227: INFO: rc: 1 May 7 21:29:37.227: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:37.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:37.939: INFO: rc: 1 May 7 21:29:37.939: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:38.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:38.925: INFO: rc: 1 May 7 21:29:38.925: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:39.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:39.931: INFO: rc: 1 May 7 21:29:39.932: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:40.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:40.927: INFO: rc: 1 May 7 21:29:40.927: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:41.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:41.950: INFO: rc: 1 May 7 21:29:41.950: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:42.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:42.928: INFO: rc: 1 May 7 21:29:42.928: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:43.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:43.926: INFO: rc: 1 May 7 21:29:43.926: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:44.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:44.918: INFO: rc: 1 May 7 21:29:44.918: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:45.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:45.933: INFO: rc: 1 May 7 21:29:45.933: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:46.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:46.950: INFO: rc: 1 May 7 21:29:46.950: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:47.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:47.925: INFO: rc: 1 May 7 21:29:47.925: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:48.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:48.917: INFO: rc: 1 May 7 21:29:48.917: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:49.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:49.931: INFO: rc: 1 May 7 21:29:49.931: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:50.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:50.903: INFO: rc: 1 May 7 21:29:50.903: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:51.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:51.938: INFO: rc: 1 May 7 21:29:51.938: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:52.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:52.918: INFO: rc: 1 May 7 21:29:52.918: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:53.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:53.919: INFO: rc: 1 May 7 21:29:53.919: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:54.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:54.925: INFO: rc: 1 May 7 21:29:54.926: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:55.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:55.923: INFO: rc: 1 May 7 21:29:55.923: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:56.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:56.941: INFO: rc: 1 May 7 21:29:56.941: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:57.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:57.929: INFO: rc: 1 May 7 21:29:57.929: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:58.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:58.933: INFO: rc: 1 May 7 21:29:58.934: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:29:59.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:29:59.921: INFO: rc: 1 May 7 21:29:59.921: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:00.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:00.958: INFO: rc: 1 May 7 21:30:00.958: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:01.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:01.943: INFO: rc: 1 May 7 21:30:01.943: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:02.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:02.939: INFO: rc: 1 May 7 21:30:02.939: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:03.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:03.924: INFO: rc: 1 May 7 21:30:03.925: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:04.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:04.934: INFO: rc: 1 May 7 21:30:04.934: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:05.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:05.938: INFO: rc: 1 May 7 21:30:05.938: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:06.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:07.267: INFO: rc: 1 May 7 21:30:07.267: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:07.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:07.944: INFO: rc: 1 May 7 21:30:07.944: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:08.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:08.942: INFO: rc: 1 May 7 21:30:08.942: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:09.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:09.938: INFO: rc: 1 May 7 21:30:09.938: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:10.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:10.933: INFO: rc: 1 May 7 21:30:10.933: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:11.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:11.942: INFO: rc: 1 May 7 21:30:11.942: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:12.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:12.934: INFO: rc: 1 May 7 21:30:12.935: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:13.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:13.923: INFO: rc: 1 May 7 21:30:13.923: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:14.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:14.938: INFO: rc: 1 May 7 21:30:14.938: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:15.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:15.932: INFO: rc: 1 May 7 21:30:15.933: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:16.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:16.934: INFO: rc: 1 May 7 21:30:16.934: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:17.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:17.910: INFO: rc: 1 May 7 21:30:17.910: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:18.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:18.949: INFO: rc: 1 May 7 21:30:18.949: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:19.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:19.934: INFO: rc: 1 May 7 21:30:19.934: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:20.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:20.943: INFO: rc: 1 May 7 21:30:20.943: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:21.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:21.943: INFO: rc: 1 May 7 21:30:21.943: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:22.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:23.052: INFO: rc: 1 May 7 21:30:23.052: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:23.667: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:23.916: INFO: rc: 1 May 7 21:30:23.916: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:24.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:24.935: INFO: rc: 1 May 7 21:30:24.935: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:25.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:25.937: INFO: rc: 1 May 7 21:30:25.937: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:26.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:26.930: INFO: rc: 1 May 7 21:30:26.930: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:27.665: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:27.933: INFO: rc: 1 May 7 21:30:27.933: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:27.933: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234' May 7 21:30:28.203: INFO: rc: 1 May 7 21:30:28.203: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2705 exec execpod26ln2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31234: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31234 nc: connect to 10.10.190.207 port 31234 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:30:28.204: FAIL: Unexpected error: <*errors.errorString | 0xc003686430>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31234 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31234 over TCP protocol occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func24.11() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1242 +0x265 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0036d6300, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "services-2705". STEP: Found 20 events. May 7 21:30:28.210: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod26ln2: { } Scheduled: Successfully assigned services-2705/execpod26ln2 to node1 May 7 21:30:28.210: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for nodeport-test-4pngn: { } Scheduled: Successfully assigned services-2705/nodeport-test-4pngn to node1 May 7 21:30:28.210: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for nodeport-test-rj7mf: { } Scheduled: Successfully assigned services-2705/nodeport-test-rj7mf to node2 May 7 21:30:28.210: INFO: At 2021-05-07 21:28:18 +0000 UTC - event for nodeport-test: {replication-controller } SuccessfulCreate: Created pod: nodeport-test-rj7mf May 7 21:30:28.210: INFO: At 2021-05-07 21:28:18 +0000 UTC - event for nodeport-test: {replication-controller } SuccessfulCreate: Created pod: nodeport-test-4pngn May 7 21:30:28.210: INFO: At 2021-05-07 21:28:19 +0000 UTC - event for nodeport-test-rj7mf: {multus } AddedInterface: Add eth0 [10.244.4.122/24] May 7 21:30:28.210: INFO: At 2021-05-07 21:28:19 +0000 UTC - event for nodeport-test-rj7mf: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 7 21:30:28.210: INFO: At 2021-05-07 21:28:20 +0000 UTC - event for nodeport-test-4pngn: {kubelet node1} Started: Started container nodeport-test May 7 21:30:28.210: INFO: At 2021-05-07 21:28:20 +0000 UTC - event for nodeport-test-4pngn: {kubelet node1} Created: Created container nodeport-test May 7 21:30:28.210: INFO: At 2021-05-07 21:28:20 +0000 UTC - event for nodeport-test-4pngn: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 473.297685ms May 7 21:30:28.210: INFO: At 2021-05-07 21:28:20 +0000 UTC - event for nodeport-test-4pngn: {multus } AddedInterface: Add eth0 [10.244.3.109/24] May 7 21:30:28.210: INFO: At 2021-05-07 21:28:20 +0000 UTC - event for nodeport-test-4pngn: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 7 21:30:28.210: INFO: At 2021-05-07 21:28:20 +0000 UTC - event for nodeport-test-rj7mf: {kubelet node2} Created: Created container nodeport-test May 7 21:30:28.210: INFO: At 2021-05-07 21:28:20 +0000 UTC - event for nodeport-test-rj7mf: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 521.604454ms May 7 21:30:28.210: INFO: At 2021-05-07 21:28:20 +0000 UTC - event for nodeport-test-rj7mf: {kubelet node2} Started: Started container nodeport-test May 7 21:30:28.210: INFO: At 2021-05-07 21:28:23 +0000 UTC - event for execpod26ln2: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 7 21:30:28.210: INFO: At 2021-05-07 21:28:23 +0000 UTC - event for execpod26ln2: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 493.075702ms May 7 21:30:28.210: INFO: At 2021-05-07 21:28:23 +0000 UTC - event for execpod26ln2: {kubelet node1} Created: Created container agnhost-container May 7 21:30:28.210: INFO: At 2021-05-07 21:28:23 +0000 UTC - event for execpod26ln2: {multus } AddedInterface: Add eth0 [10.244.3.110/24] May 7 21:30:28.210: INFO: At 2021-05-07 21:28:23 +0000 UTC - event for execpod26ln2: {kubelet node1} Started: Started container agnhost-container May 7 21:30:28.213: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:30:28.213: INFO: execpod26ln2 node1 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:21 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:24 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:24 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:21 +0000 UTC }] May 7 21:30:28.213: INFO: nodeport-test-4pngn node1 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:18 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:21 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:18 +0000 UTC }] May 7 21:30:28.213: INFO: nodeport-test-rj7mf node2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:18 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:21 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:28:18 +0000 UTC }] May 7 21:30:28.213: INFO: May 7 21:30:28.218: INFO: Logging node info for node master1 May 7 21:30:28.221: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 31401 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:25 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:25 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:25 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:30:25 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:30:28.222: INFO: Logging kubelet events for node master1 May 7 21:30:28.224: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:30:28.240: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.240: INFO: Container kube-multus ready: true, restart count 1 May 7 21:30:28.240: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:30:28.240: INFO: Container docker-registry ready: true, restart count 0 May 7 21:30:28.240: INFO: Container nginx ready: true, restart count 0 May 7 21:30:28.240: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:30:28.240: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:30:28.240: INFO: Container prometheus-operator ready: true, restart count 0 May 7 21:30:28.240: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.240: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:30:28.240: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.240: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:30:28.240: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.240: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:30:28.240: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:30:28.240: INFO: Init container install-cni ready: true, restart count 0 May 7 21:30:28.240: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:30:28.240: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.240: INFO: Container coredns ready: true, restart count 2 May 7 21:30:28.240: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.240: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:30:28.240: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:30:28.240: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:30:28.240: INFO: Container node-exporter ready: true, restart count 0 May 7 21:30:28.240: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.240: INFO: Container kube-apiserver ready: true, restart count 0 W0507 21:30:28.254975 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:30:28.286: INFO: Latency metrics for node master1 May 7 21:30:28.286: INFO: Logging node info for node master2 May 7 21:30:28.289: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 31393 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:22 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:22 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:22 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:30:22 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:30:28.290: INFO: Logging kubelet events for node master2 May 7 21:30:28.291: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:30:28.306: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.306: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:30:28.306: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.306: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:30:28.306: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.306: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:30:28.306: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.306: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:30:28.306: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:30:28.306: INFO: Init container install-cni ready: true, restart count 0 May 7 21:30:28.306: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:30:28.306: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.306: INFO: Container kube-multus ready: true, restart count 1 May 7 21:30:28.306: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.306: INFO: Container autoscaler ready: true, restart count 2 May 7 21:30:28.306: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:30:28.306: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:30:28.306: INFO: Container node-exporter ready: true, restart count 0 W0507 21:30:28.318223 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:30:28.343: INFO: Latency metrics for node master2 May 7 21:30:28.343: INFO: Logging node info for node master3 May 7 21:30:28.346: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 31388 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:22 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:22 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:22 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:30:22 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:30:28.346: INFO: Logging kubelet events for node master3 May 7 21:30:28.349: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:30:28.365: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.365: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:30:28.365: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:30:28.365: INFO: Init container install-cni ready: true, restart count 1 May 7 21:30:28.365: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:30:28.365: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.365: INFO: Container kube-multus ready: true, restart count 1 May 7 21:30:28.365: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.365: INFO: Container coredns ready: true, restart count 2 May 7 21:30:28.365: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:30:28.365: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:30:28.365: INFO: Container node-exporter ready: true, restart count 0 May 7 21:30:28.365: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.365: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:30:28.365: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.365: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:30:28.365: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.365: INFO: Container kube-scheduler ready: true, restart count 2 W0507 21:30:28.378239 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:30:28.407: INFO: Latency metrics for node master3 May 7 21:30:28.407: INFO: Logging node info for node node1 May 7 21:30:28.411: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 31387 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:21 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:21 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:21 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:30:21 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:30:28.412: INFO: Logging kubelet events for node node1 May 7 21:30:28.414: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:30:28.435: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:30:28.435: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:30:28.435: INFO: Container node-exporter ready: true, restart count 0 May 7 21:30:28.435: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:30:28.435: INFO: Container collectd ready: true, restart count 0 May 7 21:30:28.435: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:30:28.435: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:30:28.435: INFO: execpod26ln2 started at 2021-05-07 21:28:21 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container agnhost-container ready: true, restart count 0 May 7 21:30:28.435: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:30:28.435: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:30:28.435: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:30:28.435: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:30:28.435: INFO: client-envvars-6eebb421-3a32-419b-b48d-220c4773da42 started at 2021-05-07 21:25:48 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container env3cont ready: false, restart count 0 May 7 21:30:28.435: INFO: e2e-test-httpd-pod started at 2021-05-07 21:28:25 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container e2e-test-httpd-pod ready: false, restart count 0 May 7 21:30:28.435: INFO: server-envvars-e2816f49-41f1-428a-9e96-293b2452238b started at 2021-05-07 21:20:35 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container srv ready: true, restart count 0 May 7 21:30:28.435: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:30:28.435: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:30:28.435: INFO: Container discover ready: false, restart count 0 May 7 21:30:28.435: INFO: Container init ready: false, restart count 0 May 7 21:30:28.435: INFO: Container install ready: false, restart count 0 May 7 21:30:28.435: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:30:28.435: INFO: Container nodereport ready: true, restart count 0 May 7 21:30:28.435: INFO: Container reconcile ready: true, restart count 0 May 7 21:30:28.435: INFO: fail-once-local-xq6h7 started at 2021-05-07 21:26:12 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container c ready: false, restart count 0 May 7 21:30:28.435: INFO: nodeport-test-4pngn started at 2021-05-07 21:28:18 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container nodeport-test ready: true, restart count 0 May 7 21:30:28.435: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container kube-multus ready: true, restart count 1 May 7 21:30:28.435: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:30:28.435: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:30:28.435: INFO: Container grafana ready: true, restart count 0 May 7 21:30:28.435: INFO: Container prometheus ready: true, restart count 1 May 7 21:30:28.435: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:30:28.435: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 7 21:30:28.435: INFO: fail-once-local-5m46c started at 2021-05-07 21:26:12 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.435: INFO: Container c ready: false, restart count 0 May 7 21:30:28.435: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:30:28.435: INFO: Init container install-cni ready: true, restart count 2 May 7 21:30:28.435: INFO: Container kube-flannel ready: true, restart count 2 W0507 21:30:28.448122 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:30:28.480: INFO: Latency metrics for node node1 May 7 21:30:28.480: INFO: Logging node info for node node2 May 7 21:30:28.482: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 31379 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:20 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:20 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:30:20 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:30:20 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:30:28.483: INFO: Logging kubelet events for node node2 May 7 21:30:28.485: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:30:28.504: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:30:28.504: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:30:28.504: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:30:28.504: INFO: Container node-exporter ready: true, restart count 0 May 7 21:30:28.504: INFO: nodeport-test-rj7mf started at 2021-05-07 21:28:18 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container nodeport-test ready: true, restart count 0 May 7 21:30:28.504: INFO: var-expansion-f8e66cd5-ac10-4746-a81c-465a4b6408ff started at 2021-05-07 21:26:00 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container dapi-container ready: false, restart count 0 May 7 21:30:28.504: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:30:28.504: INFO: Init container install-cni ready: true, restart count 2 May 7 21:30:28.504: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:30:28.504: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container kube-multus ready: true, restart count 1 May 7 21:30:28.504: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:30:28.504: INFO: Container tas-controller ready: true, restart count 0 May 7 21:30:28.504: INFO: Container tas-extender ready: true, restart count 0 May 7 21:30:28.504: INFO: var-expansion-57d7e0be-4edf-4c50-ae38-6263f6e1c41a started at 2021-05-07 21:26:51 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container dapi-container ready: false, restart count 0 May 7 21:30:28.504: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:30:28.504: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:30:28.504: INFO: Container discover ready: false, restart count 0 May 7 21:30:28.504: INFO: Container init ready: false, restart count 0 May 7 21:30:28.504: INFO: Container install ready: false, restart count 0 May 7 21:30:28.504: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:30:28.504: INFO: Container nodereport ready: true, restart count 0 May 7 21:30:28.504: INFO: Container reconcile ready: true, restart count 0 May 7 21:30:28.504: INFO: busybox-scheduling-a81d0bf6-eebf-4742-a81c-806e1671592b started at 2021-05-07 21:27:25 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container busybox-scheduling-a81d0bf6-eebf-4742-a81c-806e1671592b ready: false, restart count 0 May 7 21:30:28.504: INFO: ss2-0 started at 2021-05-07 21:27:49 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container webserver ready: false, restart count 0 May 7 21:30:28.504: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:30:28.504: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:30:28.504: INFO: Container collectd ready: true, restart count 0 May 7 21:30:28.504: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:30:28.504: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:30:28.504: INFO: downward-api-f0dc82d8-62a1-4f8e-94bb-e4c2ec7730b4 started at 2021-05-07 21:26:15 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container dapi-container ready: false, restart count 0 May 7 21:30:28.504: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:30:28.504: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:30:28.504: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:30:28.504: INFO: test-rollover-controller-9qhvg started at 2021-05-07 21:25:56 +0000 UTC (0+1 container statuses recorded) May 7 21:30:28.504: INFO: Container httpd ready: false, restart count 0 W0507 21:30:28.516723 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:30:28.548: INFO: Latency metrics for node node2 May 7 21:30:28.549: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-2705" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:38:42.655: Unexpected error: <*errors.errorString | 0xc002ece5a0>: { s: "expected pod \"projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c\" success: Gave up after waiting 5m0s for pod \"projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c\" to be \"Succeeded or Failed\"", } expected pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c" success: Gave up after waiting 5m0s for pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [sig-storage] Projected combined /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:33:40.014: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should project all components that make up the projection API [Projection][NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-projected-all-test-volume-0cc71962-2080-4be5-b56f-134c01389e81 STEP: Creating secret with name secret-projected-all-test-volume-c8b94b0a-29b1-49c6-800e-35d6f49db6cb STEP: Creating a pod to test Check all projections for projected volume plugin May 7 21:33:40.057: INFO: Waiting up to 5m0s for pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c" in namespace "projected-2266" to be "Succeeded or Failed" May 7 21:33:40.060: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3.691833ms May 7 21:33:42.064: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006867437s May 7 21:33:44.068: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4.010801473s May 7 21:33:46.072: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 6.014848741s May 7 21:33:48.075: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 8.01796931s May 7 21:33:50.078: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 10.02102455s May 7 21:33:52.081: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 12.024171083s May 7 21:33:54.084: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 14.027778468s May 7 21:33:56.089: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 16.032018643s May 7 21:33:58.093: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 18.035902071s May 7 21:34:00.097: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 20.03979692s May 7 21:34:02.100: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 22.042986378s May 7 21:34:04.105: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 24.047907379s May 7 21:34:06.110: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 26.053559299s May 7 21:34:08.114: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 28.057669924s May 7 21:34:10.120: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 30.063364149s May 7 21:34:12.124: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 32.06723738s May 7 21:34:14.128: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 34.071600632s May 7 21:34:16.136: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 36.079567715s May 7 21:34:18.140: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 38.083594285s May 7 21:34:20.146: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 40.089149863s May 7 21:34:22.150: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 42.093502277s May 7 21:34:24.156: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 44.099552042s May 7 21:34:26.162: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 46.105371271s May 7 21:34:28.165: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 48.108405813s May 7 21:34:30.170: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 50.112812241s May 7 21:34:32.174: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 52.117078864s May 7 21:34:34.179: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 54.121831328s May 7 21:34:36.183: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 56.126086037s May 7 21:34:38.186: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 58.129677482s May 7 21:34:40.191: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.134779014s May 7 21:34:42.195: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.138516607s May 7 21:34:44.199: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.142675342s May 7 21:34:46.205: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.148194056s May 7 21:34:48.209: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.151846204s May 7 21:34:50.212: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.154856703s May 7 21:34:52.215: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.158555913s May 7 21:34:54.219: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.162689077s May 7 21:34:56.224: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.16768633s May 7 21:34:58.229: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.172054161s May 7 21:35:00.232: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.175642928s May 7 21:35:02.236: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.178836107s May 7 21:35:04.238: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.181780153s May 7 21:35:06.242: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.185752985s May 7 21:35:08.246: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.189017295s May 7 21:35:10.248: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.191536856s May 7 21:35:12.252: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.195558123s May 7 21:35:14.257: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.200486854s May 7 21:35:16.261: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.204520884s May 7 21:35:18.266: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.208803696s May 7 21:35:20.268: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.21167908s May 7 21:35:22.271: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.214748562s May 7 21:35:24.274: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.21766369s May 7 21:35:26.277: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.220465162s May 7 21:35:28.280: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.223480736s May 7 21:35:30.283: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.226778079s May 7 21:35:32.286: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.229422404s May 7 21:35:34.290: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.233415842s May 7 21:35:36.294: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.237047036s May 7 21:35:38.297: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.240558327s May 7 21:35:40.301: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.243952492s May 7 21:35:42.304: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.247435541s May 7 21:35:44.308: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.251351799s May 7 21:35:46.312: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.255606549s May 7 21:35:48.315: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.258791901s May 7 21:35:50.319: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.262689127s May 7 21:35:52.322: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.265711608s May 7 21:35:54.327: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.269875205s May 7 21:35:56.331: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.273866218s May 7 21:35:58.334: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.277274632s May 7 21:36:00.338: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.281509231s May 7 21:36:02.341: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.284592665s May 7 21:36:04.344: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.287221741s May 7 21:36:06.347: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.290017752s May 7 21:36:08.350: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.292989747s May 7 21:36:10.354: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.296966665s May 7 21:36:12.358: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.301733986s May 7 21:36:14.361: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.304760051s May 7 21:36:16.364: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.307519216s May 7 21:36:18.367: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.31041446s May 7 21:36:20.371: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.313797939s May 7 21:36:22.373: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.316458115s May 7 21:36:24.377: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.320416179s May 7 21:36:26.380: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.322952975s May 7 21:36:28.383: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.326245812s May 7 21:36:30.387: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.33061624s May 7 21:36:32.391: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.333972786s May 7 21:36:34.395: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.338401485s May 7 21:36:36.399: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.342151876s May 7 21:36:38.403: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.346786368s May 7 21:36:40.408: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.351133152s May 7 21:36:42.412: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.355146133s May 7 21:36:44.415: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.358196788s May 7 21:36:46.419: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.361849037s May 7 21:36:48.423: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.365893176s May 7 21:36:50.427: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.370059542s May 7 21:36:52.432: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.374936254s May 7 21:36:54.436: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.379614197s May 7 21:36:56.440: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.383527755s May 7 21:36:58.443: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.386284426s May 7 21:37:00.446: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.389053672s May 7 21:37:02.450: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.393501978s May 7 21:37:04.453: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.396095547s May 7 21:37:06.456: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.398842248s May 7 21:37:08.459: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.402082447s May 7 21:37:10.462: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.405378704s May 7 21:37:12.466: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.408995758s May 7 21:37:14.469: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.41274788s May 7 21:37:16.473: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.41630383s May 7 21:37:18.477: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.420182381s May 7 21:37:20.481: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.424089946s May 7 21:37:22.485: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.428736022s May 7 21:37:24.492: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.434802735s May 7 21:37:26.495: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.43782718s May 7 21:37:28.498: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.441234349s May 7 21:37:30.501: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.44416725s May 7 21:37:32.504: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.447429683s May 7 21:37:34.507: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.450485001s May 7 21:37:36.510: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.453553299s May 7 21:37:38.515: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.457868592s May 7 21:37:40.518: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.461163484s May 7 21:37:42.522: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.465445637s May 7 21:37:44.528: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.471109943s May 7 21:37:46.532: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.475026981s May 7 21:37:48.536: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.479749078s May 7 21:37:50.540: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.483609713s May 7 21:37:52.545: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.487844318s May 7 21:37:54.549: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.492140704s May 7 21:37:56.553: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.496118758s May 7 21:37:58.557: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.500169491s May 7 21:38:00.561: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.503844882s May 7 21:38:02.564: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.50768813s May 7 21:38:04.568: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.511646648s May 7 21:38:06.571: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.514688197s May 7 21:38:08.574: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.51768465s May 7 21:38:10.580: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.523717816s May 7 21:38:12.586: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.529624713s May 7 21:38:14.590: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.533456781s May 7 21:38:16.593: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.536212663s May 7 21:38:18.597: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.540105376s May 7 21:38:20.601: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.544164894s May 7 21:38:22.604: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.547388356s May 7 21:38:24.608: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.551758906s May 7 21:38:26.612: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.555390272s May 7 21:38:28.615: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.558139173s May 7 21:38:30.619: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.561975828s May 7 21:38:32.625: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.568297989s May 7 21:38:34.631: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.573895345s May 7 21:38:36.634: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.57710121s May 7 21:38:38.637: INFO: Pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.580033494s May 7 21:38:40.643: INFO: Failed to get logs from node "node2" pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c" container "projected-all-volume-test": the server rejected our request for an unknown reason (get pods projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c) STEP: delete the pod May 7 21:38:40.647: INFO: Waiting for pod projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c to disappear May 7 21:38:40.650: INFO: Pod projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c still exists May 7 21:38:42.651: INFO: Waiting for pod projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c to disappear May 7 21:38:42.654: INFO: Pod projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c no longer exists May 7 21:38:42.655: FAIL: Unexpected error: <*errors.errorString | 0xc002ece5a0>: { s: "expected pod \"projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c\" success: Gave up after waiting 5m0s for pod \"projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c\" to be \"Succeeded or Failed\"", } expected pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c" success: Gave up after waiting 5m0s for pod "projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000369a20, 0x4cd97a8, 0x31, 0xc0023f4400, 0x0, 0xc001abd1a8, 0x3, 0x3, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func21.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_combined.go:89 +0xca7 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0036d6300, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-storage] Projected combined /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "projected-2266". STEP: Found 7 events. May 7 21:38:42.660: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c: { } Scheduled: Successfully assigned projected-2266/projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c to node2 May 7 21:38:42.660: INFO: At 2021-05-07 21:33:41 +0000 UTC - event for projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c: {multus } AddedInterface: Add eth0 [10.244.4.153/24] May 7 21:38:42.660: INFO: At 2021-05-07 21:33:41 +0000 UTC - event for projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 7 21:38:42.660: INFO: At 2021-05-07 21:33:42 +0000 UTC - event for projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:38:42.660: INFO: At 2021-05-07 21:33:42 +0000 UTC - event for projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c: {kubelet node2} Failed: Error: ErrImagePull May 7 21:38:42.660: INFO: At 2021-05-07 21:33:42 +0000 UTC - event for projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 7 21:38:42.660: INFO: At 2021-05-07 21:33:42 +0000 UTC - event for projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c: {kubelet node2} Failed: Error: ImagePullBackOff May 7 21:38:42.663: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:38:42.663: INFO: May 7 21:38:42.667: INFO: Logging node info for node master1 May 7 21:38:42.670: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 35793 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:37 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:37 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:37 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:38:37 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:38:42.670: INFO: Logging kubelet events for node master1 May 7 21:38:42.673: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:38:42.683: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.683: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:38:42.683: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.683: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:38:42.683: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.683: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:38:42.683: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:38:42.683: INFO: Init container install-cni ready: true, restart count 0 May 7 21:38:42.683: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:38:42.683: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.683: INFO: Container coredns ready: true, restart count 2 May 7 21:38:42.683: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.683: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:38:42.683: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:38:42.683: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:42.683: INFO: Container node-exporter ready: true, restart count 0 May 7 21:38:42.683: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.683: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:38:42.683: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.683: INFO: Container kube-multus ready: true, restart count 1 May 7 21:38:42.683: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:38:42.683: INFO: Container docker-registry ready: true, restart count 0 May 7 21:38:42.683: INFO: Container nginx ready: true, restart count 0 May 7 21:38:42.684: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:38:42.684: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:42.684: INFO: Container prometheus-operator ready: true, restart count 0 W0507 21:38:42.696459 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:38:42.722: INFO: Latency metrics for node master1 May 7 21:38:42.722: INFO: Logging node info for node master2 May 7 21:38:42.725: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 35768 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:38:42.725: INFO: Logging kubelet events for node master2 May 7 21:38:42.727: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:38:42.736: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.736: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:38:42.736: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:38:42.736: INFO: Init container install-cni ready: true, restart count 0 May 7 21:38:42.736: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:38:42.736: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.736: INFO: Container kube-multus ready: true, restart count 1 May 7 21:38:42.736: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.736: INFO: Container autoscaler ready: true, restart count 2 May 7 21:38:42.736: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:38:42.736: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:42.736: INFO: Container node-exporter ready: true, restart count 0 May 7 21:38:42.736: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.736: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:38:42.736: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.737: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:38:42.737: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.737: INFO: Container kube-scheduler ready: true, restart count 2 W0507 21:38:42.750622 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:38:42.773: INFO: Latency metrics for node master2 May 7 21:38:42.773: INFO: Logging node info for node master3 May 7 21:38:42.775: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 35767 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:38:42.776: INFO: Logging kubelet events for node master3 May 7 21:38:42.778: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:38:42.787: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.787: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:38:42.787: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:38:42.787: INFO: Init container install-cni ready: true, restart count 1 May 7 21:38:42.787: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:38:42.787: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.787: INFO: Container kube-multus ready: true, restart count 1 May 7 21:38:42.787: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.787: INFO: Container coredns ready: true, restart count 2 May 7 21:38:42.787: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:38:42.787: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:42.787: INFO: Container node-exporter ready: true, restart count 0 May 7 21:38:42.787: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.787: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:38:42.787: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.787: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:38:42.787: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.787: INFO: Container kube-scheduler ready: true, restart count 2 W0507 21:38:42.798831 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:38:42.822: INFO: Latency metrics for node master3 May 7 21:38:42.822: INFO: Logging node info for node node1 May 7 21:38:42.826: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 35771 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:38:34 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:38:42.827: INFO: Logging kubelet events for node node1 May 7 21:38:42.829: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:38:42.844: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.844: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:38:42.844: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.844: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:38:42.844: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.844: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:38:42.844: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:38:42.844: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:42.844: INFO: Container node-exporter ready: true, restart count 0 May 7 21:38:42.844: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:38:42.844: INFO: Container collectd ready: true, restart count 0 May 7 21:38:42.844: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:38:42.844: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:38:42.844: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.844: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:38:42.844: INFO: busybox-readonly-false-485dae77-09e9-489c-93b3-0d85db80d39d started at 2021-05-07 21:37:35 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.844: INFO: Container busybox-readonly-false-485dae77-09e9-489c-93b3-0d85db80d39d ready: false, restart count 0 May 7 21:38:42.844: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.844: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:38:42.844: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:38:42.844: INFO: Container discover ready: false, restart count 0 May 7 21:38:42.844: INFO: Container init ready: false, restart count 0 May 7 21:38:42.844: INFO: Container install ready: false, restart count 0 May 7 21:38:42.844: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:38:42.844: INFO: Container nodereport ready: true, restart count 0 May 7 21:38:42.844: INFO: Container reconcile ready: true, restart count 0 May 7 21:38:42.844: INFO: fail-once-local-xq6h7 started at 2021-05-07 21:26:12 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.844: INFO: Container c ready: false, restart count 0 May 7 21:38:42.844: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.844: INFO: Container kube-multus ready: true, restart count 1 May 7 21:38:42.844: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:38:42.844: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:38:42.844: INFO: Container grafana ready: true, restart count 0 May 7 21:38:42.844: INFO: Container prometheus ready: true, restart count 1 May 7 21:38:42.844: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:38:42.844: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 7 21:38:42.844: INFO: fail-once-local-5m46c started at 2021-05-07 21:26:12 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.844: INFO: Container c ready: false, restart count 0 May 7 21:38:42.844: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:38:42.844: INFO: Init container install-cni ready: true, restart count 2 May 7 21:38:42.844: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:38:42.844: INFO: test-cleanup-controller-jlp8m started at 2021-05-07 21:36:34 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.844: INFO: Container httpd ready: false, restart count 0 W0507 21:38:42.857867 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:38:42.898: INFO: Latency metrics for node node1 May 7 21:38:42.898: INFO: Logging node info for node node2 May 7 21:38:42.901: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 35766 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:33 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:33 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:33 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:38:33 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:38:42.902: INFO: Logging kubelet events for node node2 May 7 21:38:42.904: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:38:42.913: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:38:42.913: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:42.913: INFO: Container node-exporter ready: true, restart count 0 May 7 21:38:42.913: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:38:42.913: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container kube-multus ready: true, restart count 1 May 7 21:38:42.913: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:38:42.913: INFO: Container tas-controller ready: true, restart count 0 May 7 21:38:42.913: INFO: Container tas-extender ready: true, restart count 0 May 7 21:38:42.913: INFO: downward-api-a038e9eb-c345-45ac-bdd3-4e5d7670bb4d started at 2021-05-07 21:37:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container dapi-container ready: false, restart count 0 May 7 21:38:42.913: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:38:42.913: INFO: Init container install-cni ready: true, restart count 2 May 7 21:38:42.913: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:38:42.913: INFO: ss2-0 started at 2021-05-07 21:31:12 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container webserver ready: false, restart count 0 May 7 21:38:42.913: INFO: downward-api-8f05d9d9-cf80-47e6-b1f8-1bcd5bf8908f started at 2021-05-07 21:36:16 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container dapi-container ready: false, restart count 0 May 7 21:38:42.913: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:38:42.913: INFO: Container discover ready: false, restart count 0 May 7 21:38:42.913: INFO: Container init ready: false, restart count 0 May 7 21:38:42.913: INFO: Container install ready: false, restart count 0 May 7 21:38:42.913: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:38:42.913: INFO: Container nodereport ready: true, restart count 0 May 7 21:38:42.913: INFO: Container reconcile ready: true, restart count 0 May 7 21:38:42.913: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:38:42.913: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:38:42.913: INFO: Container collectd ready: true, restart count 0 May 7 21:38:42.913: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:38:42.913: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:38:42.913: INFO: var-expansion-2a103680-c8c4-41d0-afa0-0bd8859de82a started at 2021-05-07 21:38:25 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container dapi-container ready: false, restart count 0 May 7 21:38:42.913: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:38:42.913: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:38:42.913: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:38:42.913: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:42.913: INFO: Container kube-proxy ready: true, restart count 1 W0507 21:38:42.925198 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:38:42.956: INFO: Latency metrics for node node2 May 7 21:38:42.956: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-2266" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:48:14.373: Unexpected error: <*errors.errorString | 0xc004dafa10>: { s: "expected pod \"downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3\" success: Gave up after waiting 5m0s for pod \"downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3\" to be \"Succeeded or Failed\"", } expected pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3" success: Gave up after waiting 5m0s for pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:43:11.790: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [It] should provide host IP as an env var [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward api env vars May 7 21:43:11.821: INFO: Waiting up to 5m0s for pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3" in namespace "downward-api-4796" to be "Succeeded or Failed" May 7 21:43:11.824: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2.471911ms May 7 21:43:13.827: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006135629s May 7 21:43:15.830: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009040898s May 7 21:43:17.834: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013120066s May 7 21:43:19.839: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 8.01770425s May 7 21:43:21.842: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 10.020919467s May 7 21:43:23.846: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 12.025082111s May 7 21:43:25.850: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 14.02862299s May 7 21:43:27.853: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 16.032190785s May 7 21:43:29.858: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 18.036714903s May 7 21:43:31.862: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 20.041038302s May 7 21:43:33.866: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 22.044892305s May 7 21:43:35.869: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 24.048136181s May 7 21:43:37.872: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 26.050829797s May 7 21:43:39.875: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 28.053540791s May 7 21:43:41.878: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 30.056739477s May 7 21:43:43.881: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 32.059869076s May 7 21:43:45.884: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 34.063030776s May 7 21:43:47.887: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 36.065587518s May 7 21:43:49.890: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 38.068986429s May 7 21:43:51.894: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 40.072610987s May 7 21:43:53.898: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 42.077374616s May 7 21:43:55.901: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 44.080261943s May 7 21:43:57.905: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 46.083639586s May 7 21:43:59.908: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 48.086690397s May 7 21:44:01.911: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 50.090136407s May 7 21:44:03.916: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 52.094889048s May 7 21:44:05.919: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 54.098340649s May 7 21:44:07.922: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 56.10122271s May 7 21:44:09.926: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 58.104533523s May 7 21:44:11.929: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.108177941s May 7 21:44:13.933: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.112297916s May 7 21:44:15.938: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.117175621s May 7 21:44:17.942: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.120645902s May 7 21:44:19.944: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.123352083s May 7 21:44:21.948: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.127009001s May 7 21:44:23.952: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.130541254s May 7 21:44:25.955: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.133616737s May 7 21:44:27.958: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.136652796s May 7 21:44:29.961: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.13999383s May 7 21:44:31.964: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.142446401s May 7 21:44:33.968: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.146511426s May 7 21:44:35.970: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.149223193s May 7 21:44:37.973: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.152272232s May 7 21:44:39.978: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.157291474s May 7 21:44:41.983: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.161657809s May 7 21:44:43.986: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.164770558s May 7 21:44:45.989: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.167395891s May 7 21:44:47.992: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.171316171s May 7 21:44:49.995: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.174260692s May 7 21:44:51.998: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.177051975s May 7 21:44:54.002: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.181145103s May 7 21:44:56.005: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.183774088s May 7 21:44:58.008: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.186749767s May 7 21:45:00.011: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.189440524s May 7 21:45:02.013: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.19175338s May 7 21:45:04.016: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.19463584s May 7 21:45:06.019: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.197545327s May 7 21:45:08.022: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.20118453s May 7 21:45:10.026: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.204459377s May 7 21:45:12.029: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.207606053s May 7 21:45:14.033: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.211402428s May 7 21:45:16.036: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.214715114s May 7 21:45:18.039: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.218323003s May 7 21:45:20.042: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.221053082s May 7 21:45:22.046: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.225168239s May 7 21:45:24.049: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.228269613s May 7 21:45:26.052: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.230993423s May 7 21:45:28.055: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.23428809s May 7 21:45:30.059: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.238174761s May 7 21:45:32.063: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.241828652s May 7 21:45:34.066: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.245371005s May 7 21:45:36.069: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.247847335s May 7 21:45:38.072: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.250580812s May 7 21:45:40.076: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.254897529s May 7 21:45:42.079: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.2578149s May 7 21:45:44.082: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.260847801s May 7 21:45:46.085: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.263662413s May 7 21:45:48.088: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.266719185s May 7 21:45:50.091: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.269437932s May 7 21:45:52.095: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.273852709s May 7 21:45:54.098: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.27721641s May 7 21:45:56.102: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.280629031s May 7 21:45:58.106: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.284408786s May 7 21:46:00.110: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.288513693s May 7 21:46:02.113: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.29221097s May 7 21:46:04.117: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.295579207s May 7 21:46:06.120: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.298828292s May 7 21:46:08.124: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.302529925s May 7 21:46:10.126: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.305137336s May 7 21:46:12.130: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.308847257s May 7 21:46:14.133: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.311632941s May 7 21:46:16.137: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.316126804s May 7 21:46:18.140: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.319095791s May 7 21:46:20.144: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.32325721s May 7 21:46:22.148: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.32709838s May 7 21:46:24.153: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.331906756s May 7 21:46:26.157: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.336031342s May 7 21:46:28.161: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.340012777s May 7 21:46:30.165: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.344240624s May 7 21:46:32.170: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.349088323s May 7 21:46:34.174: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.353342925s May 7 21:46:36.178: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.357216536s May 7 21:46:38.181: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.360316485s May 7 21:46:40.184: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.363121369s May 7 21:46:42.188: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.367121254s May 7 21:46:44.194: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.372469373s May 7 21:46:46.196: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.375179188s May 7 21:46:48.199: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.377519005s May 7 21:46:50.202: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.380823475s May 7 21:46:52.205: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.384204508s May 7 21:46:54.209: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.387449257s May 7 21:46:56.217: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.395406476s May 7 21:46:58.221: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.399671807s May 7 21:47:00.225: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.404063046s May 7 21:47:02.229: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.407510444s May 7 21:47:04.233: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.411647087s May 7 21:47:06.239: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.417742184s May 7 21:47:08.243: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.421647718s May 7 21:47:10.247: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.42561508s May 7 21:47:12.250: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.42909782s May 7 21:47:14.254: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.432685936s May 7 21:47:16.257: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.435542716s May 7 21:47:18.260: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.439065569s May 7 21:47:20.263: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.442091947s May 7 21:47:22.266: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.445296875s May 7 21:47:24.272: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.450705195s May 7 21:47:26.275: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.45423102s May 7 21:47:28.279: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.458136779s May 7 21:47:30.283: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.462068879s May 7 21:47:32.287: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.465781066s May 7 21:47:34.290: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.468704468s May 7 21:47:36.293: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.471920922s May 7 21:47:38.296: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.475305373s May 7 21:47:40.301: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.479418902s May 7 21:47:42.304: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.483093402s May 7 21:47:44.307: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.485571663s May 7 21:47:46.309: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.488363333s May 7 21:47:48.312: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.49073505s May 7 21:47:50.316: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.494725296s May 7 21:47:52.320: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.498751386s May 7 21:47:54.324: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.502845882s May 7 21:47:56.329: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.507683772s May 7 21:47:58.332: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.510734938s May 7 21:48:00.335: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.513412451s May 7 21:48:02.338: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.517023911s May 7 21:48:04.341: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.519483381s May 7 21:48:06.344: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.523203064s May 7 21:48:08.348: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.526636504s May 7 21:48:10.352: INFO: Pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.530860004s May 7 21:48:12.361: INFO: Failed to get logs from node "node2" pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3" container "dapi-container": the server rejected our request for an unknown reason (get pods downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3) STEP: delete the pod May 7 21:48:12.367: INFO: Waiting for pod downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3 to disappear May 7 21:48:12.370: INFO: Pod downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3 still exists May 7 21:48:14.370: INFO: Waiting for pod downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3 to disappear May 7 21:48:14.373: INFO: Pod downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3 no longer exists May 7 21:48:14.373: FAIL: Unexpected error: <*errors.errorString | 0xc004dafa10>: { s: "expected pod \"downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3\" success: Gave up after waiting 5m0s for pod \"downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3\" to be \"Succeeded or Failed\"", } expected pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3" success: Gave up after waiting 5m0s for pod "downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000e87080, 0x4c29f00, 0x15, 0xc004f90c00, 0x0, 0xc000b751a8, 0x1, 0x1, 0x4de7490) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutputRegexp(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:532 k8s.io/kubernetes/test/e2e/common.testDownwardAPIUsingPod(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:425 k8s.io/kubernetes/test/e2e/common.testDownwardAPI(0xc000e87080, 0xc002362a80, 0x31, 0xc003329ec0, 0x1, 0x1, 0xc000b751a8, 0x1, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:391 +0x75c k8s.io/kubernetes/test/e2e/common.glob..func5.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:106 +0x21d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0036d6300, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "downward-api-4796". STEP: Found 7 events. May 7 21:48:14.378: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3: { } Scheduled: Successfully assigned downward-api-4796/downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3 to node2 May 7 21:48:14.378: INFO: At 2021-05-07 21:43:13 +0000 UTC - event for downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3: {multus } AddedInterface: Add eth0 [10.244.4.186/24] May 7 21:48:14.378: INFO: At 2021-05-07 21:43:13 +0000 UTC - event for downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 7 21:48:14.378: INFO: At 2021-05-07 21:43:14 +0000 UTC - event for downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:48:14.378: INFO: At 2021-05-07 21:43:14 +0000 UTC - event for downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3: {kubelet node2} Failed: Error: ErrImagePull May 7 21:48:14.378: INFO: At 2021-05-07 21:43:15 +0000 UTC - event for downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 7 21:48:14.378: INFO: At 2021-05-07 21:43:15 +0000 UTC - event for downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3: {kubelet node2} Failed: Error: ImagePullBackOff May 7 21:48:14.380: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:48:14.381: INFO: May 7 21:48:14.385: INFO: Logging node info for node master1 May 7 21:48:14.388: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 40999 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:09 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:09 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:09 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:48:09 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:48:14.389: INFO: Logging kubelet events for node master1 May 7 21:48:14.392: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:48:14.402: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.402: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:48:14.402: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.402: INFO: Container kube-multus ready: true, restart count 1 May 7 21:48:14.402: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.402: INFO: Container docker-registry ready: true, restart count 0 May 7 21:48:14.402: INFO: Container nginx ready: true, restart count 0 May 7 21:48:14.402: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.402: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:48:14.402: INFO: Container prometheus-operator ready: true, restart count 0 May 7 21:48:14.402: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.402: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:48:14.402: INFO: Container node-exporter ready: true, restart count 0 May 7 21:48:14.402: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.402: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:48:14.402: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.402: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:48:14.402: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.402: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:48:14.402: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:48:14.402: INFO: Init container install-cni ready: true, restart count 0 May 7 21:48:14.402: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:48:14.402: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.402: INFO: Container coredns ready: true, restart count 2 May 7 21:48:14.402: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.402: INFO: Container nfd-controller ready: true, restart count 0 W0507 21:48:14.417007 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:48:14.442: INFO: Latency metrics for node master1 May 7 21:48:14.442: INFO: Logging node info for node master2 May 7 21:48:14.445: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 40973 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:48:14.445: INFO: Logging kubelet events for node master2 May 7 21:48:14.447: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:48:14.455: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:48:14.455: INFO: Init container install-cni ready: true, restart count 0 May 7 21:48:14.455: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:48:14.455: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.455: INFO: Container kube-multus ready: true, restart count 1 May 7 21:48:14.455: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.455: INFO: Container autoscaler ready: true, restart count 2 May 7 21:48:14.455: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.455: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:48:14.455: INFO: Container node-exporter ready: true, restart count 0 May 7 21:48:14.455: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.455: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:48:14.455: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.455: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:48:14.455: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.455: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:48:14.455: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.455: INFO: Container kube-proxy ready: true, restart count 1 W0507 21:48:14.467691 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:48:14.491: INFO: Latency metrics for node master2 May 7 21:48:14.491: INFO: Logging node info for node master3 May 7 21:48:14.493: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 40972 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:48:14.494: INFO: Logging kubelet events for node master3 May 7 21:48:14.496: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:48:14.504: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.504: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:48:14.504: INFO: Container node-exporter ready: true, restart count 0 May 7 21:48:14.504: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.504: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:48:14.504: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.504: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:48:14.504: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.504: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:48:14.504: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.504: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:48:14.504: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:48:14.504: INFO: Init container install-cni ready: true, restart count 1 May 7 21:48:14.504: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:48:14.504: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.504: INFO: Container kube-multus ready: true, restart count 1 May 7 21:48:14.504: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.504: INFO: Container coredns ready: true, restart count 2 W0507 21:48:14.518462 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:48:14.542: INFO: Latency metrics for node master3 May 7 21:48:14.543: INFO: Logging node info for node node1 May 7 21:48:14.546: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 40998 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:08 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:08 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:08 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:48:08 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:48:14.546: INFO: Logging kubelet events for node node1 May 7 21:48:14.549: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:48:14.564: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:48:14.564: INFO: Init container install-cni ready: true, restart count 2 May 7 21:48:14.564: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:48:14.564: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.564: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:48:14.564: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.564: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:48:14.564: INFO: Container node-exporter ready: true, restart count 0 May 7 21:48:14.564: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:48:14.564: INFO: Container collectd ready: true, restart count 0 May 7 21:48:14.564: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:48:14.564: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:48:14.564: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.564: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:48:14.564: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.564: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:48:14.564: INFO: downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626 started at 2021-05-07 21:45:03 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.564: INFO: Container dapi-container ready: false, restart count 0 May 7 21:48:14.564: INFO: affinity-clusterip-timeout-ql8wr started at 2021-05-07 21:47:23 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.564: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 May 7 21:48:14.564: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.564: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:48:14.564: INFO: pod-configmaps-9bff098c-0986-4418-bac1-582f6525d434 started at 2021-05-07 21:44:29 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.564: INFO: Container configmap-volume-binary-test ready: false, restart count 0 May 7 21:48:14.564: INFO: Container configmap-volume-data-test ready: true, restart count 0 May 7 21:48:14.564: INFO: pod-update-activedeadlineseconds-e819ac2a-3547-4d36-955f-07030411db90 started at 2021-05-07 21:47:48 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.564: INFO: Container nginx ready: false, restart count 0 May 7 21:48:14.564: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.564: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:48:14.564: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:48:14.564: INFO: Container discover ready: false, restart count 0 May 7 21:48:14.564: INFO: Container init ready: false, restart count 0 May 7 21:48:14.564: INFO: Container install ready: false, restart count 0 May 7 21:48:14.564: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.564: INFO: Container nodereport ready: true, restart count 0 May 7 21:48:14.564: INFO: Container reconcile ready: true, restart count 0 May 7 21:48:14.564: INFO: var-expansion-5ea356eb-bd92-4174-8f3e-6c8ebfbe498a started at 2021-05-07 21:44:33 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.564: INFO: Container dapi-container ready: false, restart count 0 May 7 21:48:14.564: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.564: INFO: Container kube-multus ready: true, restart count 1 May 7 21:48:14.564: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:48:14.564: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:48:14.564: INFO: Container grafana ready: true, restart count 0 May 7 21:48:14.564: INFO: Container prometheus ready: true, restart count 1 May 7 21:48:14.564: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:48:14.564: INFO: Container rules-configmap-reloader ready: true, restart count 0 W0507 21:48:14.578268 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:48:14.609: INFO: Latency metrics for node node1 May 7 21:48:14.610: INFO: Logging node info for node node2 May 7 21:48:14.612: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 40974 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:48:06 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:48:14.613: INFO: Logging kubelet events for node node2 May 7 21:48:14.616: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:48:14.628: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.628: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:48:14.628: INFO: ss-0 started at 2021-05-07 21:45:26 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.628: INFO: Container webserver ready: false, restart count 0 May 7 21:48:14.628: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.628: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:48:14.628: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.628: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:48:14.628: INFO: Container node-exporter ready: true, restart count 0 May 7 21:48:14.628: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:48:14.628: INFO: Init container install-cni ready: true, restart count 2 May 7 21:48:14.629: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:48:14.629: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.629: INFO: Container kube-multus ready: true, restart count 1 May 7 21:48:14.629: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.629: INFO: Container tas-controller ready: true, restart count 0 May 7 21:48:14.629: INFO: Container tas-extender ready: true, restart count 0 May 7 21:48:14.629: INFO: affinity-clusterip-timeout-k7wvf started at 2021-05-07 21:47:23 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.629: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 May 7 21:48:14.629: INFO: ss-0 started at 2021-05-07 21:41:12 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.629: INFO: Container webserver ready: false, restart count 0 May 7 21:48:14.629: INFO: tester started at 2021-05-07 21:45:13 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.629: INFO: Container tester ready: false, restart count 0 May 7 21:48:14.629: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.629: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:48:14.629: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:48:14.629: INFO: Container discover ready: false, restart count 0 May 7 21:48:14.629: INFO: Container init ready: false, restart count 0 May 7 21:48:14.629: INFO: Container install ready: false, restart count 0 May 7 21:48:14.629: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:48:14.629: INFO: Container nodereport ready: true, restart count 0 May 7 21:48:14.629: INFO: Container reconcile ready: true, restart count 0 May 7 21:48:14.629: INFO: server started at 2021-05-07 21:45:09 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.629: INFO: Container agnhost-container ready: true, restart count 0 May 7 21:48:14.629: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.629: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:48:14.629: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:48:14.629: INFO: Container collectd ready: true, restart count 0 May 7 21:48:14.629: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:48:14.629: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:48:14.629: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.629: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:48:14.629: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:48:14.629: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:48:14.629: INFO: pod-init-625841d8-80f4-4efd-a0cb-284795949ea7 started at 2021-05-07 21:47:12 +0000 UTC (2+1 container statuses recorded) May 7 21:48:14.629: INFO: Init container init1 ready: false, restart count 0 May 7 21:48:14.629: INFO: Init container init2 ready: false, restart count 0 May 7 21:48:14.629: INFO: Container run1 ready: false, restart count 0 W0507 21:48:14.641522 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:48:14.671: INFO: Latency metrics for node node2 May 7 21:48:14.671: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-4796" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:53:33.051: wait for pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e" to succeed Expected success, but got an error: <*errors.errorString | 0xc00303f0e0>: { s: "Gave up after waiting 5m0s for pod \"busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e\" to be \"Succeeded or Failed\"", } Gave up after waiting 5m0s for pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e" to be "Succeeded or Failed" /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:212 [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:48:32.427: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:41 [It] should run the container with uid 65534 [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:48:32.478: INFO: Waiting up to 5m0s for pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e" in namespace "security-context-test-4374" to be "Succeeded or Failed" May 7 21:48:32.480: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1.831551ms May 7 21:48:34.482: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004343441s May 7 21:48:36.485: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007090814s May 7 21:48:38.487: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 6.009472567s May 7 21:48:40.490: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 8.012476144s May 7 21:48:42.493: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 10.015309164s May 7 21:48:44.497: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 12.018519693s May 7 21:48:46.499: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 14.021368572s May 7 21:48:48.502: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 16.023771039s May 7 21:48:50.504: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 18.026391484s May 7 21:48:52.507: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 20.029335632s May 7 21:48:54.511: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 22.032665539s May 7 21:48:56.513: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 24.035404108s May 7 21:48:58.519: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 26.041299923s May 7 21:49:00.523: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 28.04487232s May 7 21:49:02.525: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 30.04746963s May 7 21:49:04.528: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 32.050118704s May 7 21:49:06.531: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 34.053363376s May 7 21:49:08.534: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 36.055654405s May 7 21:49:10.536: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 38.058400554s May 7 21:49:12.541: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 40.0624926s May 7 21:49:14.546: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 42.067918792s May 7 21:49:16.549: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 44.07081767s May 7 21:49:18.553: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 46.074582422s May 7 21:49:20.556: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 48.078231194s May 7 21:49:22.560: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 50.081871319s May 7 21:49:24.564: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 52.086123929s May 7 21:49:26.568: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 54.089568496s May 7 21:49:28.571: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 56.093117187s May 7 21:49:30.576: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 58.097494423s May 7 21:49:32.579: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.101093179s May 7 21:49:34.582: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.103916261s May 7 21:49:36.585: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.107448856s May 7 21:49:38.589: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.110679157s May 7 21:49:40.591: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.113405998s May 7 21:49:42.594: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.11643596s May 7 21:49:44.597: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.119065174s May 7 21:49:46.600: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.122163403s May 7 21:49:48.603: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.12490692s May 7 21:49:50.606: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.127963982s May 7 21:49:52.609: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.131259443s May 7 21:49:54.612: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.133844099s May 7 21:49:56.615: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.137179661s May 7 21:49:58.618: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.139702409s May 7 21:50:00.621: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.142768217s May 7 21:50:02.624: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.145568093s May 7 21:50:04.629: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.151212482s May 7 21:50:06.632: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.153821796s May 7 21:50:08.635: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.156867872s May 7 21:50:10.638: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.159650834s May 7 21:50:12.641: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.163264254s May 7 21:50:14.645: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.167395263s May 7 21:50:16.648: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.170395041s May 7 21:50:18.651: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.173207124s May 7 21:50:20.656: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.178446788s May 7 21:50:22.661: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.183242181s May 7 21:50:24.666: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.188137638s May 7 21:50:26.669: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.191259343s May 7 21:50:28.673: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.194828984s May 7 21:50:30.677: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.199355927s May 7 21:50:32.681: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.203231501s May 7 21:50:34.688: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.210328814s May 7 21:50:36.693: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.214695075s May 7 21:50:38.696: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.21797417s May 7 21:50:40.701: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.222800105s May 7 21:50:42.705: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.227467136s May 7 21:50:44.710: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.231583747s May 7 21:50:46.712: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.234457096s May 7 21:50:48.716: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.237761073s May 7 21:50:50.719: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.241265652s May 7 21:50:52.724: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.245746205s May 7 21:50:54.729: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.250821565s May 7 21:50:56.732: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.253939782s May 7 21:50:58.736: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.258375579s May 7 21:51:00.741: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.263102969s May 7 21:51:02.745: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.266900736s May 7 21:51:04.750: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.272236013s May 7 21:51:06.754: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.275492007s May 7 21:51:08.758: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.279517073s May 7 21:51:10.761: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.282717732s May 7 21:51:12.764: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.286230327s May 7 21:51:14.769: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.290794933s May 7 21:51:16.772: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.294077369s May 7 21:51:18.776: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.297881645s May 7 21:51:20.780: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.301870799s May 7 21:51:22.785: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.307047226s May 7 21:51:24.790: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.312158632s May 7 21:51:26.794: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.31577081s May 7 21:51:28.797: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.318931055s May 7 21:51:30.802: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.323953193s May 7 21:51:32.806: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.328426834s May 7 21:51:34.812: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.33436381s May 7 21:51:36.815: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.336837372s May 7 21:51:38.817: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.339473699s May 7 21:51:40.821: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.343091679s May 7 21:51:42.825: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.34690197s May 7 21:51:44.829: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.350712663s May 7 21:51:46.832: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.353930321s May 7 21:51:48.836: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.357808896s May 7 21:51:50.840: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.361635741s May 7 21:51:52.846: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.368352029s May 7 21:51:54.852: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.373558432s May 7 21:51:56.855: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.376797392s May 7 21:51:58.860: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.381699692s May 7 21:52:00.863: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.385305783s May 7 21:52:02.869: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.390555806s May 7 21:52:04.872: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.394112938s May 7 21:52:06.876: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.398080399s May 7 21:52:08.881: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.403104158s May 7 21:52:10.885: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.406923517s May 7 21:52:12.888: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.40967754s May 7 21:52:14.892: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.413631051s May 7 21:52:16.897: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.418676464s May 7 21:52:18.900: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.422084691s May 7 21:52:20.904: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.425915713s May 7 21:52:22.909: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.431053194s May 7 21:52:24.915: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.436692776s May 7 21:52:26.918: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.440180217s May 7 21:52:28.922: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.444413435s May 7 21:52:30.927: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.448866034s May 7 21:52:32.931: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.452551767s May 7 21:52:34.935: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.456893813s May 7 21:52:36.938: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.460200184s May 7 21:52:38.941: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.463206806s May 7 21:52:40.944: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.46576189s May 7 21:52:42.948: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.469719699s May 7 21:52:44.955: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.477213102s May 7 21:52:46.960: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.482337395s May 7 21:52:48.963: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.485419783s May 7 21:52:50.971: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.492852423s May 7 21:52:52.976: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.49754592s May 7 21:52:54.982: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.50438309s May 7 21:52:56.985: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.507340508s May 7 21:52:58.990: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.512186137s May 7 21:53:00.995: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.516731368s May 7 21:53:03.000: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.522451043s May 7 21:53:05.005: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.526483142s May 7 21:53:07.008: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.529764369s May 7 21:53:09.011: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.532529248s May 7 21:53:11.013: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.535477129s May 7 21:53:13.017: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.538949306s May 7 21:53:15.022: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.543775176s May 7 21:53:17.025: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.547243267s May 7 21:53:19.028: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.550386985s May 7 21:53:21.031: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.553269909s May 7 21:53:23.034: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.556456867s May 7 21:53:25.037: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.559389507s May 7 21:53:27.040: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.562279504s May 7 21:53:29.044: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.565638377s May 7 21:53:31.049: INFO: Pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.571433166s May 7 21:53:33.051: FAIL: wait for pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e" to succeed Expected success, but got an error: <*errors.errorString | 0xc00303f0e0>: { s: "Gave up after waiting 5m0s for pod \"busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e\" to be \"Succeeded or Failed\"", } Gave up after waiting 5m0s for pod "busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e" to be "Succeeded or Failed" Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).WaitForSuccess(0xc00287fb60, 0xc004db8d40, 0x37, 0x45d964b800) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:212 +0x2bb k8s.io/kubernetes/test/e2e/common.glob..func29.2.2(0xfffe) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:74 +0x29a k8s.io/kubernetes/test/e2e/common.glob..func29.2.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:84 +0x2e k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0036d6300, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-test-4374". STEP: Found 7 events. May 7 21:53:33.055: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e: { } Scheduled: Successfully assigned security-context-test-4374/busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e to node1 May 7 21:53:33.055: INFO: At 2021-05-07 21:48:34 +0000 UTC - event for busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e: {multus } AddedInterface: Add eth0 [10.244.3.178/24] May 7 21:53:33.055: INFO: At 2021-05-07 21:48:34 +0000 UTC - event for busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 7 21:53:33.055: INFO: At 2021-05-07 21:48:35 +0000 UTC - event for busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:53:33.055: INFO: At 2021-05-07 21:48:35 +0000 UTC - event for busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e: {kubelet node1} Failed: Error: ErrImagePull May 7 21:53:33.055: INFO: At 2021-05-07 21:48:35 +0000 UTC - event for busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 7 21:53:33.055: INFO: At 2021-05-07 21:48:35 +0000 UTC - event for busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:53:33.058: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:53:33.058: INFO: busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:48:32 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:48:32 +0000 UTC ContainersNotReady containers with unready status: [busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:48:32 +0000 UTC ContainersNotReady containers with unready status: [busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:48:32 +0000 UTC }] May 7 21:53:33.058: INFO: May 7 21:53:33.063: INFO: Logging node info for node master1 May 7 21:53:33.065: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 43551 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:31 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:31 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:31 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:53:31 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:53:33.066: INFO: Logging kubelet events for node master1 May 7 21:53:33.068: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:53:33.078: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:53:33.078: INFO: Init container install-cni ready: true, restart count 0 May 7 21:53:33.078: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:53:33.078: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.078: INFO: Container coredns ready: true, restart count 2 May 7 21:53:33.078: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.078: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:53:33.078: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:53:33.078: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:53:33.078: INFO: Container node-exporter ready: true, restart count 0 May 7 21:53:33.078: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.078: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:53:33.078: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.078: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:53:33.078: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.078: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:53:33.078: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:53:33.078: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:53:33.078: INFO: Container prometheus-operator ready: true, restart count 0 May 7 21:53:33.078: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.078: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:53:33.078: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.078: INFO: Container kube-multus ready: true, restart count 1 May 7 21:53:33.078: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:53:33.078: INFO: Container docker-registry ready: true, restart count 0 May 7 21:53:33.078: INFO: Container nginx ready: true, restart count 0 W0507 21:53:33.091785 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:53:33.116: INFO: Latency metrics for node master1 May 7 21:53:33.116: INFO: Logging node info for node master2 May 7 21:53:33.119: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 43532 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:27 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:27 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:27 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:53:27 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:53:33.120: INFO: Logging kubelet events for node master2 May 7 21:53:33.122: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:53:33.130: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.131: INFO: Container autoscaler ready: true, restart count 2 May 7 21:53:33.131: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:53:33.131: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:53:33.131: INFO: Container node-exporter ready: true, restart count 0 May 7 21:53:33.131: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.131: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:53:33.131: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.131: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:53:33.131: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.131: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:53:33.131: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.131: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:53:33.131: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:53:33.131: INFO: Init container install-cni ready: true, restart count 0 May 7 21:53:33.131: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:53:33.131: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.131: INFO: Container kube-multus ready: true, restart count 1 W0507 21:53:33.142314 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:53:33.165: INFO: Latency metrics for node master2 May 7 21:53:33.165: INFO: Logging node info for node master3 May 7 21:53:33.168: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 43531 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:27 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:27 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:27 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:53:27 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:53:33.168: INFO: Logging kubelet events for node master3 May 7 21:53:33.170: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:53:33.179: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.179: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:53:33.179: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.179: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:53:33.179: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.179: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:53:33.179: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:53:33.179: INFO: Init container install-cni ready: true, restart count 1 May 7 21:53:33.179: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:53:33.179: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.179: INFO: Container kube-multus ready: true, restart count 1 May 7 21:53:33.179: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.179: INFO: Container coredns ready: true, restart count 2 May 7 21:53:33.179: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:53:33.179: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:53:33.179: INFO: Container node-exporter ready: true, restart count 0 May 7 21:53:33.179: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.179: INFO: Container kube-apiserver ready: true, restart count 0 W0507 21:53:33.191765 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:53:33.216: INFO: Latency metrics for node master3 May 7 21:53:33.216: INFO: Logging node info for node node1 May 7 21:53:33.219: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 43548 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:30 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:30 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:30 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:53:30 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:53:33.219: INFO: Logging kubelet events for node node1 May 7 21:53:33.222: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:53:33.236: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:53:33.236: INFO: Init container install-cni ready: true, restart count 2 May 7 21:53:33.236: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:53:33.236: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.236: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:53:33.236: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:53:33.236: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:53:33.236: INFO: Container node-exporter ready: true, restart count 0 May 7 21:53:33.236: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:53:33.236: INFO: Container collectd ready: true, restart count 0 May 7 21:53:33.236: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:53:33.236: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:53:33.236: INFO: ss-0 started at 2021-05-07 21:49:46 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.236: INFO: Container webserver ready: false, restart count 0 May 7 21:53:33.236: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.236: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:53:33.236: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.236: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:53:33.236: INFO: busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e started at 2021-05-07 21:48:32 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.236: INFO: Container busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e ready: false, restart count 0 May 7 21:53:33.236: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.236: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:53:33.236: INFO: pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d started at 2021-05-07 21:50:07 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.236: INFO: Container nginx ready: false, restart count 0 May 7 21:53:33.236: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.236: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:53:33.236: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:53:33.236: INFO: Container discover ready: false, restart count 0 May 7 21:53:33.236: INFO: Container init ready: false, restart count 0 May 7 21:53:33.236: INFO: Container install ready: false, restart count 0 May 7 21:53:33.236: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:53:33.236: INFO: Container nodereport ready: true, restart count 0 May 7 21:53:33.236: INFO: Container reconcile ready: true, restart count 0 May 7 21:53:33.236: INFO: busybox-ac3d0690-4843-49d0-b3f1-33b5df613ef0 started at 2021-05-07 21:51:23 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.236: INFO: Container busybox ready: false, restart count 0 May 7 21:53:33.236: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.236: INFO: Container kube-multus ready: true, restart count 1 May 7 21:53:33.236: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:53:33.236: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:53:33.236: INFO: Container grafana ready: true, restart count 0 May 7 21:53:33.236: INFO: Container prometheus ready: true, restart count 1 May 7 21:53:33.236: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:53:33.236: INFO: Container rules-configmap-reloader ready: true, restart count 0 W0507 21:53:33.247650 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:53:33.277: INFO: Latency metrics for node node1 May 7 21:53:33.277: INFO: Logging node info for node node2 May 7 21:53:33.279: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 43534 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:29 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:29 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:53:29 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:53:29 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:53:33.280: INFO: Logging kubelet events for node node2 May 7 21:53:33.282: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:53:33.294: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:53:33.294: INFO: Init container install-cni ready: true, restart count 2 May 7 21:53:33.294: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:53:33.294: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.294: INFO: Container kube-multus ready: true, restart count 1 May 7 21:53:33.294: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:53:33.294: INFO: Container tas-controller ready: true, restart count 0 May 7 21:53:33.294: INFO: Container tas-extender ready: true, restart count 0 May 7 21:53:33.295: INFO: bin-false58d6a01c-d649-4e19-936c-155835d5eaeb started at 2021-05-07 21:50:41 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container bin-false58d6a01c-d649-4e19-936c-155835d5eaeb ready: false, restart count 0 May 7 21:53:33.295: INFO: busybox-host-aliasesa735d79b-e791-4100-b1f8-245b814cd445 started at 2021-05-07 21:53:16 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container busybox-host-aliasesa735d79b-e791-4100-b1f8-245b814cd445 ready: false, restart count 0 May 7 21:53:33.295: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:53:33.295: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:53:33.295: INFO: Container discover ready: false, restart count 0 May 7 21:53:33.295: INFO: Container init ready: false, restart count 0 May 7 21:53:33.295: INFO: Container install ready: false, restart count 0 May 7 21:53:33.295: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:53:33.295: INFO: Container nodereport ready: true, restart count 0 May 7 21:53:33.295: INFO: Container reconcile ready: true, restart count 0 May 7 21:53:33.295: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:53:33.295: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:53:33.295: INFO: Container collectd ready: true, restart count 0 May 7 21:53:33.295: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:53:33.295: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:53:33.295: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:53:33.295: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:53:33.295: INFO: termination-message-container6b63d0f6-861d-4f34-a23b-0b75d7cbfbfc started at 2021-05-07 21:49:02 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container termination-message-container ready: false, restart count 0 May 7 21:53:33.295: INFO: pod-handle-http-request started at 2021-05-07 21:53:30 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container pod-handle-http-request ready: true, restart count 0 May 7 21:53:33.295: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:53:33.295: INFO: ss-0 started at 2021-05-07 21:45:26 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container webserver ready: false, restart count 0 May 7 21:53:33.295: INFO: var-expansion-d2278004-0232-4b36-8c86-6f125c4c8a60 started at 2021-05-07 21:52:37 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container dapi-container ready: false, restart count 0 May 7 21:53:33.295: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:53:33.295: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:53:33.295: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:53:33.295: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:53:33.295: INFO: Container node-exporter ready: true, restart count 0 W0507 21:53:33.308235 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:53:33.340: INFO: Latency metrics for node node2 May 7 21:53:33.340: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-test-4374" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:58:35.419: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc001cda560>: { s: "failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:736 [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:53:33.358: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename deployment STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:78 [It] deployment should support proportional scaling [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:53:33.392: INFO: Creating deployment "webserver-deployment" May 7 21:53:33.397: INFO: Waiting for observed generation 1 May 7 21:53:35.402: INFO: Waiting for all required pods to come up May 7 21:53:35.406: INFO: Pod name httpd: Found 10 pods out of 10 STEP: ensuring each pod is running May 7 21:58:35.419: FAIL: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc001cda560>: { s: "failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testProportionalScalingDeployment(0xc0001f78c0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:736 +0x7ef k8s.io/kubernetes/test/e2e/apps.glob..func4.10() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:135 +0x2a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0036d6300) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0036d6300, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:72 May 7 21:58:35.424: INFO: Deployment "webserver-deployment": &Deployment{ObjectMeta:{webserver-deployment deployment-7531 /apis/apps/v1/namespaces/deployment-7531/deployments/webserver-deployment 95c45bf5-3aa7-489e-b57b-4b2ff5d5f28e 43624 1 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd] map[deployment.kubernetes.io/revision:1] [] [] [{e2e.test Update apps/v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{"f:matchLabels":{".":{},"f:name":{}}},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}}} {kube-controller-manager Update apps/v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}}}]},Spec:DeploymentSpec{Replicas:*10,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: httpd,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:httpd] map[] [] [] []} {[] [] [{httpd docker.io/library/httpd:2.4.38-alpine [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc002b6f978 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil>}},Strategy:DeploymentStrategy{Type:RollingUpdate,RollingUpdate:&RollingUpdateDeployment{MaxUnavailable:2,MaxSurge:3,},},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:1,Replicas:10,UpdatedReplicas:10,AvailableReplicas:0,UnavailableReplicas:10,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:False,Reason:MinimumReplicasUnavailable,Message:Deployment does not have minimum availability.,LastUpdateTime:2021-05-07 21:53:33 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "webserver-deployment-dd94f59b7" is progressing.,LastUpdateTime:2021-05-07 21:53:33 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,},},ReadyReplicas:0,CollisionCount:nil,},} May 7 21:58:35.427: INFO: New ReplicaSet "webserver-deployment-dd94f59b7" of Deployment "webserver-deployment": &ReplicaSet{ObjectMeta:{webserver-deployment-dd94f59b7 deployment-7531 /apis/apps/v1/namespaces/deployment-7531/replicasets/webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 43622 1 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[deployment.kubernetes.io/desired-replicas:10 deployment.kubernetes.io/max-replicas:13 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment webserver-deployment 95c45bf5-3aa7-489e-b57b-4b2ff5d5f28e 0xc002b6fdf7 0xc002b6fdf8}] [] [{kube-controller-manager Update apps/v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"95c45bf5-3aa7-489e-b57b-4b2ff5d5f28e\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:replicas":{},"f:selector":{"f:matchLabels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}},"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}}}]},Spec:ReplicaSetSpec{Replicas:*10,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: httpd,pod-template-hash: dd94f59b7,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[] [] [] []} {[] [] [{httpd docker.io/library/httpd:2.4.38-alpine [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc002b6fe68 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil>}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:10,FullyLabeledReplicas:10,ObservedGeneration:1,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} May 7 21:58:35.431: INFO: Pod "webserver-deployment-dd94f59b7-54hd5" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-54hd5 webserver-deployment-dd94f59b7- deployment-7531 /api/v1/namespaces/deployment-7531/pods/webserver-deployment-dd94f59b7-54hd5 c35489b8-b8c5-49d8-89d0-4eb9c03a7ddd 45949 0 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.189" ], "mac": "8a:4d:0c:be:cc:9c", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.189" ], "mac": "8a:4d:0c:be:cc:9c", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 0xc00054150f 0xc000541520}] [] [{kube-controller-manager Update v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"85535e3d-f5f0-4083-8275-62729e834b1d\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-05-07 21:53:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-05-07 21:53:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.189\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-gvbj2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-gvbj2,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-gvbj2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.3.189,StartTime:2021-05-07 21:53:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.189,},},EphemeralContainerStatuses:[]ContainerStatus{},},} May 7 21:58:35.432: INFO: Pod "webserver-deployment-dd94f59b7-7d7h2" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-7d7h2 webserver-deployment-dd94f59b7- deployment-7531 /api/v1/namespaces/deployment-7531/pods/webserver-deployment-dd94f59b7-7d7h2 befcffdc-a9c8-4c84-88ac-6869618186ea 45903 0 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.233" ], "mac": "ba:19:ff:f4:bd:3c", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.233" ], "mac": "ba:19:ff:f4:bd:3c", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 0xc0005416df 0xc0005416f0}] [] [{kube-controller-manager Update v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"85535e3d-f5f0-4083-8275-62729e834b1d\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-05-07 21:53:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-05-07 21:53:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.233\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-gvbj2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-gvbj2,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-gvbj2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.4.233,StartTime:2021-05-07 21:53:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.233,},},EphemeralContainerStatuses:[]ContainerStatus{},},} May 7 21:58:35.432: INFO: Pod "webserver-deployment-dd94f59b7-7xggp" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-7xggp webserver-deployment-dd94f59b7- deployment-7531 /api/v1/namespaces/deployment-7531/pods/webserver-deployment-dd94f59b7-7xggp df3edd57-a137-4905-99bd-f25218f035e6 45940 0 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.190" ], "mac": "32:af:a1:f9:41:25", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.190" ], "mac": "32:af:a1:f9:41:25", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 0xc0005418af 0xc0005418c0}] [] [{kube-controller-manager Update v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"85535e3d-f5f0-4083-8275-62729e834b1d\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-05-07 21:53:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-05-07 21:53:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.190\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-gvbj2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-gvbj2,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-gvbj2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.3.190,StartTime:2021-05-07 21:53:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.190,},},EphemeralContainerStatuses:[]ContainerStatus{},},} May 7 21:58:35.432: INFO: Pod "webserver-deployment-dd94f59b7-gnnrp" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-gnnrp webserver-deployment-dd94f59b7- deployment-7531 /api/v1/namespaces/deployment-7531/pods/webserver-deployment-dd94f59b7-gnnrp 93695143-68db-4037-a42d-66df36798535 45974 0 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.188" ], "mac": "7a:0f:02:57:5c:84", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.188" ], "mac": "7a:0f:02:57:5c:84", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 0xc000541a7f 0xc000541a90}] [] [{kube-controller-manager Update v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"85535e3d-f5f0-4083-8275-62729e834b1d\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-05-07 21:53:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-05-07 21:53:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.188\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-gvbj2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-gvbj2,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-gvbj2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.3.188,StartTime:2021-05-07 21:53:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.188,},},EphemeralContainerStatuses:[]ContainerStatus{},},} May 7 21:58:35.433: INFO: Pod "webserver-deployment-dd94f59b7-hbp9l" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-hbp9l webserver-deployment-dd94f59b7- deployment-7531 /api/v1/namespaces/deployment-7531/pods/webserver-deployment-dd94f59b7-hbp9l 44bc462a-e9ea-4ec2-b954-431eb7fdcec8 45872 0 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.236" ], "mac": "ea:88:74:d6:71:9a", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.236" ], "mac": "ea:88:74:d6:71:9a", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 0xc000541c4f 0xc000541c60}] [] [{kube-controller-manager Update v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"85535e3d-f5f0-4083-8275-62729e834b1d\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-05-07 21:53:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-05-07 21:53:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.236\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-gvbj2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-gvbj2,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-gvbj2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.4.236,StartTime:2021-05-07 21:53:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.236,},},EphemeralContainerStatuses:[]ContainerStatus{},},} May 7 21:58:35.433: INFO: Pod "webserver-deployment-dd94f59b7-lkk66" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-lkk66 webserver-deployment-dd94f59b7- deployment-7531 /api/v1/namespaces/deployment-7531/pods/webserver-deployment-dd94f59b7-lkk66 1938467c-2591-4520-b87d-040ec85e848b 45969 0 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.187" ], "mac": "ee:53:d7:c6:54:5f", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.187" ], "mac": "ee:53:d7:c6:54:5f", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 0xc000541e1f 0xc000541e30}] [] [{kube-controller-manager Update v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"85535e3d-f5f0-4083-8275-62729e834b1d\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-05-07 21:53:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-05-07 21:53:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.187\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-gvbj2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-gvbj2,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-gvbj2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.3.187,StartTime:2021-05-07 21:53:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.187,},},EphemeralContainerStatuses:[]ContainerStatus{},},} May 7 21:58:35.433: INFO: Pod "webserver-deployment-dd94f59b7-rqdcf" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-rqdcf webserver-deployment-dd94f59b7- deployment-7531 /api/v1/namespaces/deployment-7531/pods/webserver-deployment-dd94f59b7-rqdcf c33b658d-66d6-44f7-969e-a475a33f4817 45933 0 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.237" ], "mac": "c2:cb:d3:33:46:86", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.237" ], "mac": "c2:cb:d3:33:46:86", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 0xc000541fef 0xc004690000}] [] [{kube-controller-manager Update v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"85535e3d-f5f0-4083-8275-62729e834b1d\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-05-07 21:53:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-05-07 21:53:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.237\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-gvbj2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-gvbj2,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-gvbj2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.4.237,StartTime:2021-05-07 21:53:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.237,},},EphemeralContainerStatuses:[]ContainerStatus{},},} May 7 21:58:35.433: INFO: Pod "webserver-deployment-dd94f59b7-rvv98" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-rvv98 webserver-deployment-dd94f59b7- deployment-7531 /api/v1/namespaces/deployment-7531/pods/webserver-deployment-dd94f59b7-rvv98 6d721359-7517-43bf-91ae-a7b3a0cec77d 45883 0 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.191" ], "mac": "f6:7f:21:54:e3:ff", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.191" ], "mac": "f6:7f:21:54:e3:ff", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 0xc0046901bf 0xc0046901d0}] [] [{kube-controller-manager Update v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"85535e3d-f5f0-4083-8275-62729e834b1d\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-05-07 21:53:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-05-07 21:53:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.191\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-gvbj2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-gvbj2,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-gvbj2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.3.191,StartTime:2021-05-07 21:53:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.191,},},EphemeralContainerStatuses:[]ContainerStatus{},},} May 7 21:58:35.434: INFO: Pod "webserver-deployment-dd94f59b7-smk7q" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-smk7q webserver-deployment-dd94f59b7- deployment-7531 /api/v1/namespaces/deployment-7531/pods/webserver-deployment-dd94f59b7-smk7q bab446bb-40d0-4452-905d-678d4642f1bd 45950 0 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.231" ], "mac": "c2:e0:a9:ee:bc:db", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.231" ], "mac": "c2:e0:a9:ee:bc:db", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 0xc00469038f 0xc0046903a0}] [] [{kube-controller-manager Update v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"85535e3d-f5f0-4083-8275-62729e834b1d\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-05-07 21:53:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-05-07 21:53:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.231\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-gvbj2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-gvbj2,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-gvbj2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.4.231,StartTime:2021-05-07 21:53:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.231,},},EphemeralContainerStatuses:[]ContainerStatus{},},} May 7 21:58:35.434: INFO: Pod "webserver-deployment-dd94f59b7-wgwgb" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-wgwgb webserver-deployment-dd94f59b7- deployment-7531 /api/v1/namespaces/deployment-7531/pods/webserver-deployment-dd94f59b7-wgwgb 10856758-8776-4b63-8b71-a0a3381abe18 45944 0 2021-05-07 21:53:33 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.232" ], "mac": "6e:d3:e4:ad:f9:7c", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.232" ], "mac": "6e:d3:e4:ad:f9:7c", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 85535e3d-f5f0-4083-8275-62729e834b1d 0xc00469055f 0xc004690570}] [] [{kube-controller-manager Update v1 2021-05-07 21:53:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"85535e3d-f5f0-4083-8275-62729e834b1d\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-05-07 21:53:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-05-07 21:53:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.232\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-gvbj2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-gvbj2,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-gvbj2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-05-07 21:53:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.4.232,StartTime:2021-05-07 21:53:33 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.232,},},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "deployment-7531". STEP: Found 83 events. May 7 21:58:35.439: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-54hd5: { } Scheduled: Successfully assigned deployment-7531/webserver-deployment-dd94f59b7-54hd5 to node1 May 7 21:58:35.439: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-7d7h2: { } Scheduled: Successfully assigned deployment-7531/webserver-deployment-dd94f59b7-7d7h2 to node2 May 7 21:58:35.439: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-7xggp: { } Scheduled: Successfully assigned deployment-7531/webserver-deployment-dd94f59b7-7xggp to node1 May 7 21:58:35.439: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-gnnrp: { } Scheduled: Successfully assigned deployment-7531/webserver-deployment-dd94f59b7-gnnrp to node1 May 7 21:58:35.439: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-hbp9l: { } Scheduled: Successfully assigned deployment-7531/webserver-deployment-dd94f59b7-hbp9l to node2 May 7 21:58:35.439: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-lkk66: { } Scheduled: Successfully assigned deployment-7531/webserver-deployment-dd94f59b7-lkk66 to node1 May 7 21:58:35.439: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-rqdcf: { } Scheduled: Successfully assigned deployment-7531/webserver-deployment-dd94f59b7-rqdcf to node2 May 7 21:58:35.439: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-rvv98: { } Scheduled: Successfully assigned deployment-7531/webserver-deployment-dd94f59b7-rvv98 to node1 May 7 21:58:35.439: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-smk7q: { } Scheduled: Successfully assigned deployment-7531/webserver-deployment-dd94f59b7-smk7q to node2 May 7 21:58:35.439: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-wgwgb: { } Scheduled: Successfully assigned deployment-7531/webserver-deployment-dd94f59b7-wgwgb to node2 May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set webserver-deployment-dd94f59b7 to 10 May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-7d7h2 May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-wgwgb May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-7xggp May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-lkk66 May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-gnnrp May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: (combined from similar events): Created pod: webserver-deployment-dd94f59b7-smk7q May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-hbp9l May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-rvv98 May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-rqdcf May 7 21:58:35.439: INFO: At 2021-05-07 21:53:33 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-54hd5 May 7 21:58:35.439: INFO: At 2021-05-07 21:53:35 +0000 UTC - event for webserver-deployment-dd94f59b7-smk7q: {multus } AddedInterface: Add eth0 [10.244.4.231/24] May 7 21:58:35.439: INFO: At 2021-05-07 21:53:35 +0000 UTC - event for webserver-deployment-dd94f59b7-smk7q: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:36 +0000 UTC - event for webserver-deployment-dd94f59b7-gnnrp: {multus } AddedInterface: Add eth0 [10.244.3.188/24] May 7 21:58:35.439: INFO: At 2021-05-07 21:53:36 +0000 UTC - event for webserver-deployment-dd94f59b7-lkk66: {multus } AddedInterface: Add eth0 [10.244.3.187/24] May 7 21:58:35.439: INFO: At 2021-05-07 21:53:36 +0000 UTC - event for webserver-deployment-dd94f59b7-smk7q: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:58:35.439: INFO: At 2021-05-07 21:53:36 +0000 UTC - event for webserver-deployment-dd94f59b7-smk7q: {kubelet node2} Failed: Error: ErrImagePull May 7 21:58:35.439: INFO: At 2021-05-07 21:53:37 +0000 UTC - event for webserver-deployment-dd94f59b7-54hd5: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:37 +0000 UTC - event for webserver-deployment-dd94f59b7-54hd5: {multus } AddedInterface: Add eth0 [10.244.3.189/24] May 7 21:58:35.439: INFO: At 2021-05-07 21:53:37 +0000 UTC - event for webserver-deployment-dd94f59b7-7xggp: {multus } AddedInterface: Add eth0 [10.244.3.190/24] May 7 21:58:35.439: INFO: At 2021-05-07 21:53:37 +0000 UTC - event for webserver-deployment-dd94f59b7-7xggp: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:37 +0000 UTC - event for webserver-deployment-dd94f59b7-gnnrp: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:37 +0000 UTC - event for webserver-deployment-dd94f59b7-lkk66: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:37 +0000 UTC - event for webserver-deployment-dd94f59b7-rvv98: {multus } AddedInterface: Add eth0 [10.244.3.191/24] May 7 21:58:35.439: INFO: At 2021-05-07 21:53:37 +0000 UTC - event for webserver-deployment-dd94f59b7-rvv98: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:38 +0000 UTC - event for webserver-deployment-dd94f59b7-7d7h2: {multus } AddedInterface: Add eth0 [10.244.4.233/24] May 7 21:58:35.439: INFO: At 2021-05-07 21:53:38 +0000 UTC - event for webserver-deployment-dd94f59b7-lkk66: {kubelet node1} Failed: Error: ErrImagePull May 7 21:58:35.439: INFO: At 2021-05-07 21:53:38 +0000 UTC - event for webserver-deployment-dd94f59b7-lkk66: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:38 +0000 UTC - event for webserver-deployment-dd94f59b7-lkk66: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:58:35.439: INFO: At 2021-05-07 21:53:38 +0000 UTC - event for webserver-deployment-dd94f59b7-lkk66: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:58:35.439: INFO: At 2021-05-07 21:53:38 +0000 UTC - event for webserver-deployment-dd94f59b7-rqdcf: {multus } AddedInterface: Add eth0 [10.244.4.234/24] May 7 21:58:35.439: INFO: At 2021-05-07 21:53:38 +0000 UTC - event for webserver-deployment-dd94f59b7-smk7q: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:38 +0000 UTC - event for webserver-deployment-dd94f59b7-smk7q: {kubelet node2} Failed: Error: ImagePullBackOff May 7 21:58:35.439: INFO: At 2021-05-07 21:53:38 +0000 UTC - event for webserver-deployment-dd94f59b7-wgwgb: {multus } AddedInterface: Add eth0 [10.244.4.232/24] May 7 21:58:35.439: INFO: At 2021-05-07 21:53:38 +0000 UTC - event for webserver-deployment-dd94f59b7-wgwgb: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:39 +0000 UTC - event for webserver-deployment-dd94f59b7-7d7h2: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:39 +0000 UTC - event for webserver-deployment-dd94f59b7-gnnrp: {kubelet node1} Failed: Error: ErrImagePull May 7 21:58:35.439: INFO: At 2021-05-07 21:53:39 +0000 UTC - event for webserver-deployment-dd94f59b7-gnnrp: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:58:35.439: INFO: At 2021-05-07 21:53:39 +0000 UTC - event for webserver-deployment-dd94f59b7-gnnrp: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:58:35.439: INFO: At 2021-05-07 21:53:39 +0000 UTC - event for webserver-deployment-dd94f59b7-gnnrp: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:39 +0000 UTC - event for webserver-deployment-dd94f59b7-hbp9l: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:39 +0000 UTC - event for webserver-deployment-dd94f59b7-hbp9l: {multus } AddedInterface: Add eth0 [10.244.4.236/24] May 7 21:58:35.439: INFO: At 2021-05-07 21:53:39 +0000 UTC - event for webserver-deployment-dd94f59b7-rqdcf: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.439: INFO: At 2021-05-07 21:53:39 +0000 UTC - event for webserver-deployment-dd94f59b7-wgwgb: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:58:35.439: INFO: At 2021-05-07 21:53:39 +0000 UTC - event for webserver-deployment-dd94f59b7-wgwgb: {kubelet node2} Failed: Error: ErrImagePull May 7 21:58:35.439: INFO: At 2021-05-07 21:53:40 +0000 UTC - event for webserver-deployment-dd94f59b7-7xggp: {kubelet node1} Failed: Error: ErrImagePull May 7 21:58:35.439: INFO: At 2021-05-07 21:53:40 +0000 UTC - event for webserver-deployment-dd94f59b7-7xggp: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:58:35.439: INFO: At 2021-05-07 21:53:40 +0000 UTC - event for webserver-deployment-dd94f59b7-7xggp: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.440: INFO: At 2021-05-07 21:53:40 +0000 UTC - event for webserver-deployment-dd94f59b7-7xggp: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:58:35.440: INFO: At 2021-05-07 21:53:40 +0000 UTC - event for webserver-deployment-dd94f59b7-hbp9l: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.440: INFO: At 2021-05-07 21:53:40 +0000 UTC - event for webserver-deployment-dd94f59b7-hbp9l: {kubelet node2} Failed: Error: ErrImagePull May 7 21:58:35.440: INFO: At 2021-05-07 21:53:40 +0000 UTC - event for webserver-deployment-dd94f59b7-hbp9l: {kubelet node2} Failed: Error: ImagePullBackOff May 7 21:58:35.440: INFO: At 2021-05-07 21:53:40 +0000 UTC - event for webserver-deployment-dd94f59b7-hbp9l: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:58:35.440: INFO: At 2021-05-07 21:53:40 +0000 UTC - event for webserver-deployment-dd94f59b7-wgwgb: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.440: INFO: At 2021-05-07 21:53:40 +0000 UTC - event for webserver-deployment-dd94f59b7-wgwgb: {kubelet node2} Failed: Error: ImagePullBackOff May 7 21:58:35.440: INFO: At 2021-05-07 21:53:41 +0000 UTC - event for webserver-deployment-dd94f59b7-54hd5: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.440: INFO: At 2021-05-07 21:53:41 +0000 UTC - event for webserver-deployment-dd94f59b7-54hd5: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:58:35.440: INFO: At 2021-05-07 21:53:41 +0000 UTC - event for webserver-deployment-dd94f59b7-54hd5: {kubelet node1} Failed: Error: ErrImagePull May 7 21:58:35.440: INFO: At 2021-05-07 21:53:41 +0000 UTC - event for webserver-deployment-dd94f59b7-54hd5: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:58:35.440: INFO: At 2021-05-07 21:53:41 +0000 UTC - event for webserver-deployment-dd94f59b7-rqdcf: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 7 21:58:35.440: INFO: At 2021-05-07 21:53:41 +0000 UTC - event for webserver-deployment-dd94f59b7-rqdcf: {kubelet node2} Failed: Error: ErrImagePull May 7 21:58:35.440: INFO: At 2021-05-07 21:53:41 +0000 UTC - event for webserver-deployment-dd94f59b7-rqdcf: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:58:35.440: INFO: At 2021-05-07 21:53:42 +0000 UTC - event for webserver-deployment-dd94f59b7-rvv98: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.440: INFO: At 2021-05-07 21:53:42 +0000 UTC - event for webserver-deployment-dd94f59b7-rvv98: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:58:35.440: INFO: At 2021-05-07 21:53:42 +0000 UTC - event for webserver-deployment-dd94f59b7-rvv98: {kubelet node1} Failed: Error: ErrImagePull May 7 21:58:35.440: INFO: At 2021-05-07 21:53:42 +0000 UTC - event for webserver-deployment-dd94f59b7-rvv98: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:58:35.440: INFO: At 2021-05-07 21:53:43 +0000 UTC - event for webserver-deployment-dd94f59b7-7d7h2: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:58:35.440: INFO: At 2021-05-07 21:53:43 +0000 UTC - event for webserver-deployment-dd94f59b7-7d7h2: {kubelet node2} Failed: Error: ErrImagePull May 7 21:58:35.440: INFO: At 2021-05-07 21:53:43 +0000 UTC - event for webserver-deployment-dd94f59b7-rqdcf: {multus } AddedInterface: Add eth0 [10.244.4.237/24] May 7 21:58:35.440: INFO: At 2021-05-07 21:53:43 +0000 UTC - event for webserver-deployment-dd94f59b7-rqdcf: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.440: INFO: At 2021-05-07 21:53:43 +0000 UTC - event for webserver-deployment-dd94f59b7-rqdcf: {kubelet node2} Failed: Error: ImagePullBackOff May 7 21:58:35.440: INFO: At 2021-05-07 21:53:44 +0000 UTC - event for webserver-deployment-dd94f59b7-7d7h2: {kubelet node2} Failed: Error: ImagePullBackOff May 7 21:58:35.440: INFO: At 2021-05-07 21:53:44 +0000 UTC - event for webserver-deployment-dd94f59b7-7d7h2: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:58:35.443: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:58:35.443: INFO: webserver-deployment-dd94f59b7-54hd5 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC }] May 7 21:58:35.443: INFO: webserver-deployment-dd94f59b7-7d7h2 node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC }] May 7 21:58:35.443: INFO: webserver-deployment-dd94f59b7-7xggp node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC }] May 7 21:58:35.443: INFO: webserver-deployment-dd94f59b7-gnnrp node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC }] May 7 21:58:35.443: INFO: webserver-deployment-dd94f59b7-hbp9l node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC }] May 7 21:58:35.443: INFO: webserver-deployment-dd94f59b7-lkk66 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC }] May 7 21:58:35.443: INFO: webserver-deployment-dd94f59b7-rqdcf node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC }] May 7 21:58:35.443: INFO: webserver-deployment-dd94f59b7-rvv98 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC }] May 7 21:58:35.443: INFO: webserver-deployment-dd94f59b7-smk7q node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC }] May 7 21:58:35.444: INFO: webserver-deployment-dd94f59b7-wgwgb node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:53:33 +0000 UTC }] May 7 21:58:35.444: INFO: May 7 21:58:35.448: INFO: Logging node info for node master1 May 7 21:58:35.450: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 46355 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:32 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:32 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:32 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:58:32 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:58:35.451: INFO: Logging kubelet events for node master1 May 7 21:58:35.453: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:58:35.463: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.463: INFO: Container kube-multus ready: true, restart count 1 May 7 21:58:35.463: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:58:35.463: INFO: Container docker-registry ready: true, restart count 0 May 7 21:58:35.463: INFO: Container nginx ready: true, restart count 0 May 7 21:58:35.463: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:58:35.463: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:35.463: INFO: Container prometheus-operator ready: true, restart count 0 May 7 21:58:35.463: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.463: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:58:35.463: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.463: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:58:35.463: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.463: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:58:35.463: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:58:35.463: INFO: Init container install-cni ready: true, restart count 0 May 7 21:58:35.463: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:58:35.463: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.463: INFO: Container coredns ready: true, restart count 2 May 7 21:58:35.463: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.463: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:58:35.463: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:58:35.463: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:35.463: INFO: Container node-exporter ready: true, restart count 0 May 7 21:58:35.463: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.463: INFO: Container kube-apiserver ready: true, restart count 0 W0507 21:58:35.477738 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:58:35.505: INFO: Latency metrics for node master1 May 7 21:58:35.505: INFO: Logging node info for node master2 May 7 21:58:35.507: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 46342 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:29 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:29 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:29 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:58:29 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:58:35.508: INFO: Logging kubelet events for node master2 May 7 21:58:35.510: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:58:35.518: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.518: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:58:35.518: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.518: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:58:35.518: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.518: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:58:35.518: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:58:35.518: INFO: Init container install-cni ready: true, restart count 0 May 7 21:58:35.518: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:58:35.518: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.518: INFO: Container kube-multus ready: true, restart count 1 May 7 21:58:35.518: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.518: INFO: Container autoscaler ready: true, restart count 2 May 7 21:58:35.518: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:58:35.518: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:35.518: INFO: Container node-exporter ready: true, restart count 0 May 7 21:58:35.518: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.518: INFO: Container kube-apiserver ready: true, restart count 0 W0507 21:58:35.531500 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:58:35.564: INFO: Latency metrics for node master2 May 7 21:58:35.564: INFO: Logging node info for node master3 May 7 21:58:35.567: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 46341 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:28 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:28 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:28 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:58:28 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:58:35.567: INFO: Logging kubelet events for node master3 May 7 21:58:35.569: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:58:35.577: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.578: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:58:35.578: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:58:35.578: INFO: Init container install-cni ready: true, restart count 1 May 7 21:58:35.578: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:58:35.578: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.578: INFO: Container kube-multus ready: true, restart count 1 May 7 21:58:35.578: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.578: INFO: Container coredns ready: true, restart count 2 May 7 21:58:35.578: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:58:35.578: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:35.578: INFO: Container node-exporter ready: true, restart count 0 May 7 21:58:35.578: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.578: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:58:35.578: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.578: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:58:35.578: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.578: INFO: Container kube-scheduler ready: true, restart count 2 W0507 21:58:35.589973 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:58:35.613: INFO: Latency metrics for node master3 May 7 21:58:35.613: INFO: Logging node info for node node1 May 7 21:58:35.616: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 46354 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:31 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:31 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:31 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:58:31 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:58:35.617: INFO: Logging kubelet events for node node1 May 7 21:58:35.618: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:58:35.633: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:58:35.633: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:58:35.633: INFO: Container discover ready: false, restart count 0 May 7 21:58:35.633: INFO: Container init ready: false, restart count 0 May 7 21:58:35.633: INFO: Container install ready: false, restart count 0 May 7 21:58:35.633: INFO: webserver-deployment-dd94f59b7-7xggp started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container httpd ready: false, restart count 0 May 7 21:58:35.633: INFO: webserver-deployment-dd94f59b7-lkk66 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container httpd ready: false, restart count 0 May 7 21:58:35.633: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:58:35.633: INFO: Container nodereport ready: true, restart count 0 May 7 21:58:35.633: INFO: Container reconcile ready: true, restart count 0 May 7 21:58:35.633: INFO: webserver-deployment-dd94f59b7-54hd5 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container httpd ready: false, restart count 0 May 7 21:58:35.633: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container kube-multus ready: true, restart count 1 May 7 21:58:35.633: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:58:35.633: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:58:35.633: INFO: Container grafana ready: true, restart count 0 May 7 21:58:35.633: INFO: Container prometheus ready: true, restart count 1 May 7 21:58:35.633: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:58:35.633: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 7 21:58:35.633: INFO: webserver-deployment-dd94f59b7-rvv98 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container httpd ready: false, restart count 0 May 7 21:58:35.633: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:58:35.633: INFO: Init container install-cni ready: true, restart count 2 May 7 21:58:35.633: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:58:35.633: INFO: pod-configmaps-492a36ce-a6ac-401e-9fb5-5e28913c3fd4 started at 2021-05-07 21:54:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container env-test ready: false, restart count 0 May 7 21:58:35.633: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:58:35.633: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:58:35.633: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:58:35.633: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:58:35.633: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:35.633: INFO: Container node-exporter ready: true, restart count 0 May 7 21:58:35.633: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:58:35.633: INFO: Container collectd ready: true, restart count 0 May 7 21:58:35.633: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:58:35.633: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:58:35.633: INFO: ss-0 started at 2021-05-07 21:49:46 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container webserver ready: false, restart count 0 May 7 21:58:35.633: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:58:35.633: INFO: foo-ln5vh started at 2021-05-07 21:55:35 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container c ready: false, restart count 0 May 7 21:58:35.633: INFO: webserver-deployment-dd94f59b7-gnnrp started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.633: INFO: Container httpd ready: false, restart count 0 W0507 21:58:35.646575 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:58:35.698: INFO: Latency metrics for node node1 May 7 21:58:35.698: INFO: Logging node info for node node2 May 7 21:58:35.701: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 46353 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:31 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:31 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:31 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:58:31 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:58:35.702: INFO: Logging kubelet events for node node2 May 7 21:58:35.704: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:58:35.718: INFO: webserver-deployment-dd94f59b7-smk7q started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container httpd ready: false, restart count 0 May 7 21:58:35.718: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:58:35.718: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:58:35.718: INFO: Container discover ready: false, restart count 0 May 7 21:58:35.718: INFO: Container init ready: false, restart count 0 May 7 21:58:35.718: INFO: Container install ready: false, restart count 0 May 7 21:58:35.718: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:58:35.718: INFO: Container nodereport ready: true, restart count 0 May 7 21:58:35.718: INFO: Container reconcile ready: true, restart count 0 May 7 21:58:35.718: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:58:35.718: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:58:35.718: INFO: Container collectd ready: true, restart count 0 May 7 21:58:35.718: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:58:35.718: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:58:35.718: INFO: webserver-deployment-dd94f59b7-wgwgb started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container httpd ready: false, restart count 0 May 7 21:58:35.718: INFO: webserver-deployment-dd94f59b7-hbp9l started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container httpd ready: false, restart count 0 May 7 21:58:35.718: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:58:35.718: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:58:35.718: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:58:35.718: INFO: foo-jwlrh started at 2021-05-07 21:55:35 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container c ready: false, restart count 0 May 7 21:58:35.718: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:58:35.718: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:58:35.718: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:35.718: INFO: Container node-exporter ready: true, restart count 0 May 7 21:58:35.718: INFO: webserver-deployment-dd94f59b7-7d7h2 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container httpd ready: false, restart count 0 May 7 21:58:35.718: INFO: webserver-deployment-dd94f59b7-rqdcf started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container httpd ready: false, restart count 0 May 7 21:58:35.718: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:58:35.718: INFO: Init container install-cni ready: true, restart count 2 May 7 21:58:35.718: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:58:35.718: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:35.718: INFO: Container kube-multus ready: true, restart count 1 May 7 21:58:35.718: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:58:35.718: INFO: Container tas-controller ready: true, restart count 0 May 7 21:58:35.718: INFO: Container tas-extender ready: true, restart count 0 W0507 21:58:35.731367 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:58:35.779: INFO: Latency metrics for node node2 May 7 21:58:35.779: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "deployment-7531" for this suite.