/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking_perf.go:56 Mar 11 20:52:55.004: Fatal error waiting for iperf server endpoint : Timeout while waiting for pods with labels "app=iperf-e2e-pod" to be running /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking_perf.go:89 [BeforeEach] [sig-network] Networking IPerf IPv4 [Experimental] [Feature:Networking-IPv4] [Slow] [Feature:Networking-Performance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:178 STEP: Creating a kubernetes client Mar 11 20:42:54.627: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename network-perf STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in network-perf-593 STEP: Waiting for a default service account to be provisioned in namespace [It] should transfer ~ 1GB onto the service endpoint 1 servers (maximum of 1 clients) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking_perf.go:56 Mar 11 20:42:54.752: INFO: Creating a service-for-iperf-e2e for selecting app=iperf-e2e-pod Mar 11 20:42:54.763: INFO: 0/1 : Creating container with label app=iperf-e2e-pod Mar 11 20:52:55.004: FAIL: Fatal error waiting for iperf server endpoint : Timeout while waiting for pods with labels "app=iperf-e2e-pod" to be running Full Stack Trace k8s.io/kubernetes/test/e2e/network.networkingIPerfTest.func1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking_perf.go:89 +0x20a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001d58100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:125 +0x324 k8s.io/kubernetes/test/e2e.TestE2E(0xc001d58100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:111 +0x2b testing.tRunner(0xc001d58100, 0x4afad60) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-network] Networking IPerf IPv4 [Experimental] [Feature:Networking-IPv4] [Slow] [Feature:Networking-Performance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:179 STEP: Collecting events from namespace "network-perf-593". STEP: Found 5 events. Mar 11 20:52:55.009: INFO: At 2021-03-11 20:42:56 +0000 UTC - event for iperf-e2e-pod-0: {multus } AddedInterface: Add eth0 [10.244.3.29/24] Mar 11 20:52:55.009: INFO: At 2021-03-11 20:42:56 +0000 UTC - event for iperf-e2e-pod-0: {kubelet node1} Pulling: Pulling image "us.gcr.io/k8s-artifacts-prod/e2e-test-images/agnhost:2.12" Mar 11 20:52:55.009: INFO: At 2021-03-11 20:42:56 +0000 UTC - event for iperf-e2e-pod-0: {kubelet node1} Pulled: Successfully pulled image "us.gcr.io/k8s-artifacts-prod/e2e-test-images/agnhost:2.12" Mar 11 20:52:55.009: INFO: At 2021-03-11 20:42:57 +0000 UTC - event for iperf-e2e-pod-0: {kubelet node1} Created: Created container iperf-server Mar 11 20:52:55.009: INFO: At 2021-03-11 20:42:57 +0000 UTC - event for iperf-e2e-pod-0: {kubelet node1} Started: Started container iperf-server Mar 11 20:52:55.012: INFO: POD NODE PHASE GRACE CONDITIONS Mar 11 20:52:55.012: INFO: iperf-e2e-pod-0 node1 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:42:54 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:42:54 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:42:54 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:42:54 +0000 UTC }] Mar 11 20:52:55.012: INFO: Mar 11 20:52:55.016: INFO: Logging node info for node master1 Mar 11 20:52:55.019: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 bc51b401-422a-4e82-b449-caa7cdc72ceb 63300 0 2021-03-11 17:50:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0e:0e:ac:80:fe:e5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-03-11 17:50:19 +0000 UTC FieldsV1 FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 107 117 98 101 97 100 109 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 114 105 45 115 111 99 107 101 116 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 110 111 100 101 45 114 111 108 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 97 115 116 101 114 34 58 123 125 125 125 125],}} {kube-controller-manager Update v1 2021-03-11 17:52:41 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 111 100 101 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 116 116 108 34 58 123 125 125 125 44 34 102 58 115 112 101 99 34 58 123 34 102 58 112 111 100 67 73 68 82 34 58 123 125 44 34 102 58 112 111 100 67 73 68 82 115 34 58 123 34 46 34 58 123 125 44 34 118 58 92 34 49 48 46 50 52 52 46 48 46 48 47 50 52 92 34 34 58 123 125 125 44 34 102 58 116 97 105 110 116 115 34 58 123 125 125 125],}} {flanneld Update v1 2021-03-11 17:54:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 100 97 116 97 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 116 121 112 101 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 107 117 98 101 45 115 117 98 110 101 116 45 109 97 110 97 103 101 114 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 112 117 98 108 105 99 45 105 112 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 78 101 116 119 111 114 107 85 110 97 118 97 105 108 97 98 108 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 125 125],}} {kubelet Update v1 2021-03-11 20:52:50 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 102 58 118 111 108 117 109 101 115 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 111 110 116 114 111 108 108 101 114 45 109 97 110 97 103 101 100 45 97 116 116 97 99 104 45 100 101 116 97 99 104 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 46 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 104 111 115 116 110 97 109 101 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 97 100 100 114 101 115 115 101 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 72 111 115 116 110 97 109 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 73 110 116 101 114 110 97 108 73 80 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 97 108 108 111 99 97 116 97 98 108 101 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 68 105 115 107 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 77 101 109 111 114 121 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 80 73 68 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 82 101 97 100 121 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 100 97 101 109 111 110 69 110 100 112 111 105 110 116 115 34 58 123 34 102 58 107 117 98 101 108 101 116 69 110 100 112 111 105 110 116 34 58 123 34 102 58 80 111 114 116 34 58 123 125 125 125 44 34 102 58 105 109 97 103 101 115 34 58 123 125 44 34 102 58 110 111 100 101 73 110 102 111 34 58 123 34 102 58 97 114 99 104 105 116 101 99 116 117 114 101 34 58 123 125 44 34 102 58 98 111 111 116 73 68 34 58 123 125 44 34 102 58 99 111 110 116 97 105 110 101 114 82 117 110 116 105 109 101 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 101 114 110 101 108 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 80 114 111 120 121 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 108 101 116 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 109 97 99 104 105 110 101 73 68 34 58 123 125 44 34 102 58 111 112 101 114 97 116 105 110 103 83 121 115 116 101 109 34 58 123 125 44 34 102 58 111 115 73 109 97 103 101 34 58 123 125 44 34 102 58 115 121 115 116 101 109 85 85 73 68 34 58 123 125 125 125 125],}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234776064 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200361918464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-03-11 17:54:32 +0000 UTC,LastTransitionTime:2021-03-11 17:54:32 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:52:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0cb21bb9b8b64bf38523b2f5a8bdad14,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:4a77cc46-4c80-409c-8c40-c24648f76e32,KernelVersion:3.10.0-1160.15.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.12,KubeletVersion:v1.18.8,KubeProxyVersion:v1.18.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:38cd3fe450dcded05650b49cd4c95b41fce97503892b5b760e9395d127bdf276 kubernetesui/dashboard-amd64:v2.0.2],SizeBytes:224634189,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:e9071531a6aa14fe50d882a68f10ee710d5203dd4bb07ff7a87d29cdc5a1fd5b k8s.gcr.io/kube-apiserver:v1.18.8],SizeBytes:173029757,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:8a2b2a8d3e586afdd223e096ab65db865d6dce680336f0b9f0d764b21abba06f k8s.gcr.io/kube-controller-manager:v1.18.8],SizeBytes:162425213,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:6f6bd5c06680713d1047f7e27794c7c7d11e6859de5787dd4ca17d204669e683 k8s.gcr.io/kube-proxy:v1.18.8],SizeBytes:117264685,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:ec7c376c780a3dd02d7e5850a0ca3d09fc8df50ac3ceb37a2214d403585361a0 k8s.gcr.io/kube-scheduler:v1.18.8],SizeBytes:95308157,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:41ed47389c835eb68215e8215f6d4bfa5123923afd7550dbae049cded27c41b4 quay.io/coreos/etcd:v3.4.3],SizeBytes:83576774,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:6d451d92c921f14bfb38196aacb6e506d4593c5b3c9d40a8b8a2506010dc3e10 quay.io/coreos/flannel:v0.12.0],SizeBytes:52767393,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[lachlanevenson/k8s-helm@sha256:dcf2036282694c6bfe2a533636dd8f494f63186b98e4118e741be04a9115af6a lachlanevenson/k8s-helm:v3.2.3],SizeBytes:46479395,},ContainerImage{Names:[coredns/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c coredns/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:40684734,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:a7f6555decef3c061cfb669be5137d2209690cafe459204126e01276f113b9af kubernetesui/metrics-scraper:v1.0.5],SizeBytes:36703493,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:0a63703fc308c6cb4207a707146ef234ff92011ee350289beec821e9a2c42765 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:23811271,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:96cd5db59860a84139d8d35c2e7662504a7c6cba7810831ed9374e0ddd9b1333 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5617799,},ContainerImage{Names:[alpine@sha256:a75afd8b57e7f34e4dad8d65e2c7ba2e1975c795ce1ee22fa34f8cf46f96a3be alpine:latest],SizeBytes:5613158,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 11 20:52:55.020: INFO: Logging kubelet events for node master1 Mar 11 20:52:55.024: INFO: Logging pods the kubelet thinks is on node master1 Mar 11 20:52:55.039: INFO: kube-controller-manager-master1 started at 2021-03-11 17:57:56 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.039: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 11 20:52:55.039: INFO: kube-proxy-bwz9p started at 2021-03-11 17:51:51 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.039: INFO: Container kube-proxy ready: true, restart count 1 Mar 11 20:52:55.039: INFO: kube-flannel-pzw7v started at 2021-03-11 17:52:37 +0000 UTC (1+1 container statuses recorded) Mar 11 20:52:55.039: INFO: Init container install-cni ready: true, restart count 2 Mar 11 20:52:55.039: INFO: Container kube-flannel ready: true, restart count 1 Mar 11 20:52:55.039: INFO: kube-scheduler-master1 started at 2021-03-11 18:07:23 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.039: INFO: Container kube-scheduler ready: true, restart count 1 Mar 11 20:52:55.039: INFO: kube-apiserver-master1 started at 2021-03-11 17:51:21 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.039: INFO: Container kube-apiserver ready: true, restart count 0 Mar 11 20:52:55.039: INFO: kube-multus-ds-amd64-2jdtx started at 2021-03-11 17:52:47 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.039: INFO: Container kube-multus ready: true, restart count 1 Mar 11 20:52:55.039: INFO: docker-registry-docker-registry-6d4484d8f9-pkjwp started at 2021-03-11 17:55:49 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.039: INFO: Container docker-registry ready: true, restart count 0 Mar 11 20:52:55.039: INFO: Container nginx ready: true, restart count 0 Mar 11 20:52:55.039: INFO: node-exporter-b54mc started at 2021-03-11 18:04:28 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.039: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.039: INFO: Container node-exporter ready: true, restart count 0 Mar 11 20:52:55.039: INFO: coredns-59dcc4799b-qsq4q started at 2021-03-11 20:35:16 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.039: INFO: Container coredns ready: true, restart count 0 Mar 11 20:52:55.075: INFO: Latency metrics for node master1 Mar 11 20:52:55.075: INFO: Logging node info for node master2 Mar 11 20:52:55.078: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 81d12a4f-6154-421a-896a-6071517cc7cf 63295 0 2021-03-11 17:50:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"8a:67:dc:b1:33:9d"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-03-11 17:50:55 +0000 UTC FieldsV1 FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 107 117 98 101 97 100 109 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 114 105 45 115 111 99 107 101 116 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 110 111 100 101 45 114 111 108 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 97 115 116 101 114 34 58 123 125 125 125 125],}} {kube-controller-manager Update v1 2021-03-11 17:52:41 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 111 100 101 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 116 116 108 34 58 123 125 125 125 44 34 102 58 115 112 101 99 34 58 123 34 102 58 112 111 100 67 73 68 82 34 58 123 125 44 34 102 58 112 111 100 67 73 68 82 115 34 58 123 34 46 34 58 123 125 44 34 118 58 92 34 49 48 46 50 52 52 46 50 46 48 47 50 52 92 34 34 58 123 125 125 44 34 102 58 116 97 105 110 116 115 34 58 123 125 125 125],}} {flanneld Update v1 2021-03-11 17:54:35 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 100 97 116 97 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 116 121 112 101 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 107 117 98 101 45 115 117 98 110 101 116 45 109 97 110 97 103 101 114 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 112 117 98 108 105 99 45 105 112 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 78 101 116 119 111 114 107 85 110 97 118 97 105 108 97 98 108 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 125 125],}} {kubelet Update v1 2021-03-11 20:52:50 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 102 58 118 111 108 117 109 101 115 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 111 110 116 114 111 108 108 101 114 45 109 97 110 97 103 101 100 45 97 116 116 97 99 104 45 100 101 116 97 99 104 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 46 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 104 111 115 116 110 97 109 101 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 97 100 100 114 101 115 115 101 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 72 111 115 116 110 97 109 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 73 110 116 101 114 110 97 108 73 80 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 97 108 108 111 99 97 116 97 98 108 101 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 68 105 115 107 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 77 101 109 111 114 121 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 80 73 68 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 82 101 97 100 121 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 100 97 101 109 111 110 69 110 100 112 111 105 110 116 115 34 58 123 34 102 58 107 117 98 101 108 101 116 69 110 100 112 111 105 110 116 34 58 123 34 102 58 80 111 114 116 34 58 123 125 125 125 44 34 102 58 105 109 97 103 101 115 34 58 123 125 44 34 102 58 110 111 100 101 73 110 102 111 34 58 123 34 102 58 97 114 99 104 105 116 101 99 116 117 114 101 34 58 123 125 44 34 102 58 98 111 111 116 73 68 34 58 123 125 44 34 102 58 99 111 110 116 97 105 110 101 114 82 117 110 116 105 109 101 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 101 114 110 101 108 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 80 114 111 120 121 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 108 101 116 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 109 97 99 104 105 110 101 73 68 34 58 123 125 44 34 102 58 111 112 101 114 97 116 105 110 103 83 121 115 116 101 109 34 58 123 125 44 34 102 58 111 115 73 109 97 103 101 34 58 123 125 44 34 102 58 115 121 115 116 101 109 85 85 73 68 34 58 123 125 125 125 125],}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234771968 0} {<nil>} 196518332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200361914368 0} {<nil>} 195665932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-03-11 17:54:35 +0000 UTC,LastTransitionTime:2021-03-11 17:54:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:52:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b3061860c4ba472e9c76577f315c0ddb,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:bc6d20a6-057d-4d5d-af80-cb65b29e2a9f,KernelVersion:3.10.0-1160.15.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.12,KubeletVersion:v1.18.8,KubeProxyVersion:v1.18.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:38cd3fe450dcded05650b49cd4c95b41fce97503892b5b760e9395d127bdf276 kubernetesui/dashboard-amd64:v2.0.2],SizeBytes:224634189,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:e9071531a6aa14fe50d882a68f10ee710d5203dd4bb07ff7a87d29cdc5a1fd5b k8s.gcr.io/kube-apiserver:v1.18.8],SizeBytes:173029757,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:8a2b2a8d3e586afdd223e096ab65db865d6dce680336f0b9f0d764b21abba06f k8s.gcr.io/kube-controller-manager:v1.18.8],SizeBytes:162425213,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:6f6bd5c06680713d1047f7e27794c7c7d11e6859de5787dd4ca17d204669e683 k8s.gcr.io/kube-proxy:v1.18.8],SizeBytes:117264685,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:ec7c376c780a3dd02d7e5850a0ca3d09fc8df50ac3ceb37a2214d403585361a0 k8s.gcr.io/kube-scheduler:v1.18.8],SizeBytes:95308157,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:41ed47389c835eb68215e8215f6d4bfa5123923afd7550dbae049cded27c41b4 quay.io/coreos/etcd:v3.4.3],SizeBytes:83576774,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:6d451d92c921f14bfb38196aacb6e506d4593c5b3c9d40a8b8a2506010dc3e10 quay.io/coreos/flannel:v0.12.0],SizeBytes:52767393,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[lachlanevenson/k8s-helm@sha256:dcf2036282694c6bfe2a533636dd8f494f63186b98e4118e741be04a9115af6a lachlanevenson/k8s-helm:v3.2.3],SizeBytes:46479395,},ContainerImage{Names:[coredns/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c coredns/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:40684734,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:a7f6555decef3c061cfb669be5137d2209690cafe459204126e01276f113b9af kubernetesui/metrics-scraper:v1.0.5],SizeBytes:36703493,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 11 20:52:55.079: INFO: Logging kubelet events for node master2 Mar 11 20:52:55.082: INFO: Logging pods the kubelet thinks is on node master2 Mar 11 20:52:55.095: INFO: kube-proxy-qg4j5 started at 2021-03-11 17:51:51 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.095: INFO: Container kube-proxy ready: true, restart count 1 Mar 11 20:52:55.095: INFO: kube-flannel-kfjhn started at 2021-03-11 17:52:37 +0000 UTC (1+1 container statuses recorded) Mar 11 20:52:55.095: INFO: Init container install-cni ready: true, restart count 0 Mar 11 20:52:55.095: INFO: Container kube-flannel ready: true, restart count 2 Mar 11 20:52:55.095: INFO: kube-multus-ds-amd64-xx6h7 started at 2021-03-11 17:52:47 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.095: INFO: Container kube-multus ready: true, restart count 1 Mar 11 20:52:55.095: INFO: node-exporter-j8bwb started at 2021-03-11 18:04:28 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.095: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.095: INFO: Container node-exporter ready: true, restart count 0 Mar 11 20:52:55.095: INFO: kube-apiserver-master2 started at 2021-03-11 17:54:26 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.095: INFO: Container kube-apiserver ready: true, restart count 0 Mar 11 20:52:55.095: INFO: kube-controller-manager-master2 started at 2021-03-11 17:57:56 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.095: INFO: Container kube-controller-manager ready: true, restart count 2 Mar 11 20:52:55.095: INFO: kube-scheduler-master2 started at 2021-03-11 17:57:56 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.095: INFO: Container kube-scheduler ready: true, restart count 2 Mar 11 20:52:55.124: INFO: Latency metrics for node master2 Mar 11 20:52:55.124: INFO: Logging node info for node master3 Mar 11 20:52:55.128: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 2ec4f135-9e61-46a6-a537-0ad6199eddb1 63301 0 2021-03-11 17:50:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:4a:32:07:d3:68"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.5.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-03-11 17:50:55 +0000 UTC FieldsV1 FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 107 117 98 101 97 100 109 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 114 105 45 115 111 99 107 101 116 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 110 111 100 101 45 114 111 108 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 97 115 116 101 114 34 58 123 125 125 125 125],}} {kube-controller-manager Update v1 2021-03-11 17:52:41 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 111 100 101 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 116 116 108 34 58 123 125 125 125 44 34 102 58 115 112 101 99 34 58 123 34 102 58 112 111 100 67 73 68 82 34 58 123 125 44 34 102 58 112 111 100 67 73 68 82 115 34 58 123 34 46 34 58 123 125 44 34 118 58 92 34 49 48 46 50 52 52 46 49 46 48 47 50 52 92 34 34 58 123 125 125 44 34 102 58 116 97 105 110 116 115 34 58 123 125 125 125],}} {flanneld Update v1 2021-03-11 17:54:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 100 97 116 97 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 116 121 112 101 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 107 117 98 101 45 115 117 98 110 101 116 45 109 97 110 97 103 101 114 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 112 117 98 108 105 99 45 105 112 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 78 101 116 119 111 114 107 85 110 97 118 97 105 108 97 98 108 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 125 125],}} {nfd-master Update v1 2021-03-11 17:59:05 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 102 100 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 97 115 116 101 114 46 118 101 114 115 105 111 110 34 58 123 125 125 125 125],}} {kubelet Update v1 2021-03-11 20:52:51 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 102 58 118 111 108 117 109 101 115 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 111 110 116 114 111 108 108 101 114 45 109 97 110 97 103 101 100 45 97 116 116 97 99 104 45 100 101 116 97 99 104 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 46 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 104 111 115 116 110 97 109 101 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 97 100 100 114 101 115 115 101 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 72 111 115 116 110 97 109 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 73 110 116 101 114 110 97 108 73 80 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 97 108 108 111 99 97 116 97 98 108 101 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 68 105 115 107 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 77 101 109 111 114 121 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 80 73 68 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 82 101 97 100 121 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 100 97 101 109 111 110 69 110 100 112 111 105 110 116 115 34 58 123 34 102 58 107 117 98 101 108 101 116 69 110 100 112 111 105 110 116 34 58 123 34 102 58 80 111 114 116 34 58 123 125 125 125 44 34 102 58 105 109 97 103 101 115 34 58 123 125 44 34 102 58 110 111 100 101 73 110 102 111 34 58 123 34 102 58 97 114 99 104 105 116 101 99 116 117 114 101 34 58 123 125 44 34 102 58 98 111 111 116 73 68 34 58 123 125 44 34 102 58 99 111 110 116 97 105 110 101 114 82 117 110 116 105 109 101 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 101 114 110 101 108 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 80 114 111 120 121 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 108 101 116 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 109 97 99 104 105 110 101 73 68 34 58 123 125 44 34 102 58 111 112 101 114 97 116 105 110 103 83 121 115 116 101 109 34 58 123 125 44 34 102 58 111 115 73 109 97 103 101 34 58 123 125 44 34 102 58 115 121 115 116 101 109 85 85 73 68 34 58 123 125 125 125 125],}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234776064 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200361918464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-03-11 17:54:32 +0000 UTC,LastTransitionTime:2021-03-11 17:54:32 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:51 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:51 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:51 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-03-11 20:52:51 +0000 UTC,LastTransitionTime:2021-03-11 17:54:26 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4167bf4cb2634ca88fc2626bbda0ce42,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:52af946c-b482-4940-ad01-ee4a9a06c438,KernelVersion:3.10.0-1160.15.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.12,KubeletVersion:v1.18.8,KubeProxyVersion:v1.18.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:38cd3fe450dcded05650b49cd4c95b41fce97503892b5b760e9395d127bdf276 kubernetesui/dashboard-amd64:v2.0.2],SizeBytes:224634189,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:e9071531a6aa14fe50d882a68f10ee710d5203dd4bb07ff7a87d29cdc5a1fd5b k8s.gcr.io/kube-apiserver:v1.18.8],SizeBytes:173029757,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:8a2b2a8d3e586afdd223e096ab65db865d6dce680336f0b9f0d764b21abba06f k8s.gcr.io/kube-controller-manager:v1.18.8],SizeBytes:162425213,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:6f6bd5c06680713d1047f7e27794c7c7d11e6859de5787dd4ca17d204669e683 k8s.gcr.io/kube-proxy:v1.18.8],SizeBytes:117264685,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:ec7c376c780a3dd02d7e5850a0ca3d09fc8df50ac3ceb37a2214d403585361a0 k8s.gcr.io/kube-scheduler:v1.18.8],SizeBytes:95308157,},ContainerImage{Names:[quay.io/kubernetes_incubator/node-feature-discovery@sha256:99fe53b4555e717de68505ec46a10bc0e19c5e0d998fde5035bb623a65c75916 quay.io/kubernetes_incubator/node-feature-discovery:v0.5.0],SizeBytes:86455274,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:41ed47389c835eb68215e8215f6d4bfa5123923afd7550dbae049cded27c41b4 quay.io/coreos/etcd:v3.4.3],SizeBytes:83576774,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:6d451d92c921f14bfb38196aacb6e506d4593c5b3c9d40a8b8a2506010dc3e10 quay.io/coreos/flannel:v0.12.0],SizeBytes:52767393,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[lachlanevenson/k8s-helm@sha256:dcf2036282694c6bfe2a533636dd8f494f63186b98e4118e741be04a9115af6a lachlanevenson/k8s-helm:v3.2.3],SizeBytes:46479395,},ContainerImage{Names:[coredns/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c coredns/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:40684734,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:a7f6555decef3c061cfb669be5137d2209690cafe459204126e01276f113b9af kubernetesui/metrics-scraper:v1.0.5],SizeBytes:36703493,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 11 20:52:55.129: INFO: Logging kubelet events for node master3 Mar 11 20:52:55.133: INFO: Logging pods the kubelet thinks is on node master3 Mar 11 20:52:55.148: INFO: kube-proxy-ktvzn started at 2021-03-11 17:51:51 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.148: INFO: Container kube-proxy ready: true, restart count 1 Mar 11 20:52:55.148: INFO: kube-flannel-fkd4q started at 2021-03-11 17:52:37 +0000 UTC (1+1 container statuses recorded) Mar 11 20:52:55.148: INFO: Init container install-cni ready: true, restart count 0 Mar 11 20:52:55.148: INFO: Container kube-flannel ready: true, restart count 1 Mar 11 20:52:55.148: INFO: kube-multus-ds-amd64-94kvc started at 2021-03-11 17:52:47 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.148: INFO: Container kube-multus ready: true, restart count 1 Mar 11 20:52:55.148: INFO: dns-autoscaler-66498f5c5f-m7mx4 started at 2021-03-11 17:53:11 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.148: INFO: Container autoscaler ready: true, restart count 1 Mar 11 20:52:55.148: INFO: kube-apiserver-master3 started at 2021-03-11 17:54:26 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.148: INFO: Container kube-apiserver ready: true, restart count 0 Mar 11 20:52:55.148: INFO: kube-controller-manager-master3 started at 2021-03-11 17:54:26 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.148: INFO: Container kube-controller-manager ready: true, restart count 2 Mar 11 20:52:55.148: INFO: kube-scheduler-master3 started at 2021-03-11 17:51:21 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.148: INFO: Container kube-scheduler ready: true, restart count 2 Mar 11 20:52:55.148: INFO: node-feature-discovery-controller-ccc948bcc-k5xj8 started at 2021-03-11 17:58:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.148: INFO: Container nfd-controller ready: true, restart count 0 Mar 11 20:52:55.148: INFO: node-exporter-xgq5j started at 2021-03-11 18:04:28 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.148: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.148: INFO: Container node-exporter ready: true, restart count 0 Mar 11 20:52:55.148: INFO: coredns-59dcc4799b-8wbvl started at 2021-03-11 20:35:16 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.148: INFO: Container coredns ready: true, restart count 0 Mar 11 20:52:55.181: INFO: Latency metrics for node master3 Mar 11 20:52:55.181: INFO: Logging node info for node node1 Mar 11 20:52:55.183: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 09564b93-d658-496c-8cb0-ca1148040536 63282 0 2021-03-11 17:51:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.15.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.minor: kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:2f:67:81:a9:4b"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major,system-os_release.VERSION_ID.minor nfd.node.kubernetes.io/worker.version:v0.5.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-03-11 17:51:58 +0000 UTC FieldsV1 FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 111 100 101 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 116 116 108 34 58 123 125 125 125 44 34 102 58 115 112 101 99 34 58 123 34 102 58 112 111 100 67 73 68 82 34 58 123 125 44 34 102 58 112 111 100 67 73 68 82 115 34 58 123 34 46 34 58 123 125 44 34 118 58 92 34 49 48 46 50 52 52 46 51 46 48 47 50 52 92 34 34 58 123 125 125 125 125],}} {kubeadm Update v1 2021-03-11 17:51:59 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 107 117 98 101 97 100 109 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 114 105 45 115 111 99 107 101 116 34 58 123 125 125 125 125],}} {flanneld Update v1 2021-03-11 17:54:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 100 97 116 97 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 116 121 112 101 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 107 117 98 101 45 115 117 98 110 101 116 45 109 97 110 97 103 101 114 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 112 117 98 108 105 99 45 105 112 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 78 101 116 119 111 114 107 85 110 97 118 97 105 108 97 98 108 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 125 125],}} {nfd-master Update v1 2021-03-11 17:59:05 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 102 100 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 102 101 97 116 117 114 101 45 108 97 98 101 108 115 34 58 123 125 44 34 102 58 110 102 100 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 119 111 114 107 101 114 46 118 101 114 115 105 111 110 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 68 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 69 83 78 73 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 50 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 66 87 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 67 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 68 81 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 70 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 86 76 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 70 77 65 51 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 72 76 69 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 73 66 80 66 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 77 80 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 82 84 77 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 83 84 73 66 80 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 86 77 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 104 97 114 100 119 97 114 101 95 109 117 108 116 105 116 104 114 101 97 100 105 110 103 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 112 115 116 97 116 101 46 116 117 114 98 111 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 67 77 84 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 76 51 67 65 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 66 65 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 66 77 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 79 78 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 99 111 110 102 105 103 46 78 79 95 72 90 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 99 111 110 102 105 103 46 78 79 95 72 90 95 70 85 76 76 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 115 101 108 105 110 117 120 46 101 110 97 98 108 101 100 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 102 117 108 108 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 109 97 106 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 109 105 110 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 114 101 118 105 115 105 111 110 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 101 109 111 114 121 45 110 117 109 97 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 110 101 116 119 111 114 107 45 115 114 105 111 118 46 99 97 112 97 98 108 101 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 110 101 116 119 111 114 107 45 115 114 105 111 118 46 99 111 110 102 105 103 117 114 101 100 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 112 99 105 45 48 51 48 48 95 49 97 48 51 46 112 114 101 115 101 110 116 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 116 111 114 97 103 101 45 110 111 110 114 111 116 97 116 105 111 110 97 108 100 105 115 107 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 73 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 46 109 97 106 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 46 109 105 110 111 114 34 58 123 125 125 125 125],}} {Swagger-Codegen Update v1 2021-03-11 18:03:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 99 109 107 45 110 111 100 101 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 101 120 99 108 117 115 105 118 101 45 99 111 114 101 115 34 58 123 125 125 125 125],}} {kubelet Update v1 2021-03-11 20:52:45 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 102 58 118 111 108 117 109 101 115 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 111 110 116 114 111 108 108 101 114 45 109 97 110 97 103 101 100 45 97 116 116 97 99 104 45 100 101 116 97 99 104 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 46 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 104 111 115 116 110 97 109 101 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 97 100 100 114 101 115 115 101 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 72 111 115 116 110 97 109 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 73 110 116 101 114 110 97 108 73 80 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 97 108 108 111 99 97 116 97 98 108 101 34 58 123 34 46 34 58 123 125 44 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 101 120 99 108 117 115 105 118 101 45 99 111 114 101 115 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 105 110 116 101 108 46 99 111 109 47 105 110 116 101 108 95 115 114 105 111 118 95 110 101 116 100 101 118 105 99 101 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 105 110 116 101 108 46 99 111 109 47 105 110 116 101 108 95 115 114 105 111 118 95 110 101 116 100 101 118 105 99 101 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 68 105 115 107 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 77 101 109 111 114 121 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 80 73 68 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 82 101 97 100 121 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 100 97 101 109 111 110 69 110 100 112 111 105 110 116 115 34 58 123 34 102 58 107 117 98 101 108 101 116 69 110 100 112 111 105 110 116 34 58 123 34 102 58 80 111 114 116 34 58 123 125 125 125 44 34 102 58 105 109 97 103 101 115 34 58 123 125 44 34 102 58 110 111 100 101 73 110 102 111 34 58 123 34 102 58 97 114 99 104 105 116 101 99 116 117 114 101 34 58 123 125 44 34 102 58 98 111 111 116 73 68 34 58 123 125 44 34 102 58 99 111 110 116 97 105 110 101 114 82 117 110 116 105 109 101 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 101 114 110 101 108 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 80 114 111 120 121 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 108 101 116 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 109 97 99 104 105 110 101 73 68 34 58 123 125 44 34 102 58 111 112 101 114 97 116 105 110 103 83 121 115 116 101 109 34 58 123 125 44 34 102 58 111 115 73 109 97 103 101 34 58 123 125 44 34 102 58 115 121 115 116 101 109 85 85 73 68 34 58 123 125 125 125 125],}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201259671552 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178911977472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-03-11 17:54:32 +0000 UTC,LastTransitionTime:2021-03-11 17:54:32 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:58:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14aafcebb52e4debae4bcb2b7efb6066,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:87cad20c-59df-4889-8b1c-8831f7bcac2e,KernelVersion:3.10.0-1160.15.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.12,KubeletVersion:v1.18.8,KubeProxyVersion:v1.18.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[opnfv/barometer-collectd@sha256:18abffcf9afb2c3cb0afac67de5f1317f7dcd8925906c434f4e18812d9efbb54],SizeBytes:1727353823,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002423280,},ContainerImage{Names:[localhost:30500/cmk@sha256:fdd523af421b0b21e1d9a0699b629bc50687a7de7dcea78afe470b8eaeed4ae2 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:5ae9a5d4f882cae1ddfb3aeb6c5c6645df57e77e3bdaf9083c3cde45c7f9cbc2 golang:alpine3.12],SizeBytes:301038054,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:e9071531a6aa14fe50d882a68f10ee710d5203dd4bb07ff7a87d29cdc5a1fd5b k8s.gcr.io/kube-apiserver:v1.18.8],SizeBytes:173029757,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:8a2b2a8d3e586afdd223e096ab65db865d6dce680336f0b9f0d764b21abba06f k8s.gcr.io/kube-controller-manager:v1.18.8],SizeBytes:162425213,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:f3693fe50d5b1df1ecd315d54813a77afd56b0245a404055a946574deb6b34fc nginx:1.19],SizeBytes:133050457,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:6f6bd5c06680713d1047f7e27794c7c7d11e6859de5787dd4ca17d204669e683 k8s.gcr.io/kube-proxy:v1.18.8],SizeBytes:117264685,},ContainerImage{Names:[us.gcr.io/k8s-artifacts-prod/e2e-test-images/agnhost@sha256:1d7f0d77a6f07fd507f147a38d06a7c8269ebabd4f923bfe46d4fb8b396a520c us.gcr.io/k8s-artifacts-prod/e2e-test-images/agnhost:2.12],SizeBytes:111705925,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:ec7c376c780a3dd02d7e5850a0ca3d09fc8df50ac3ceb37a2214d403585361a0 k8s.gcr.io/kube-scheduler:v1.18.8],SizeBytes:95308157,},ContainerImage{Names:[quay.io/kubernetes_incubator/node-feature-discovery@sha256:99fe53b4555e717de68505ec46a10bc0e19c5e0d998fde5035bb623a65c75916 quay.io/kubernetes_incubator/node-feature-discovery:v0.5.0],SizeBytes:86455274,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:6d451d92c921f14bfb38196aacb6e506d4593c5b3c9d40a8b8a2506010dc3e10 quay.io/coreos/flannel:v0.12.0],SizeBytes:52767393,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[lachlanevenson/k8s-helm@sha256:dcf2036282694c6bfe2a533636dd8f494f63186b98e4118e741be04a9115af6a lachlanevenson/k8s-helm:v3.2.3],SizeBytes:46479395,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:0ebc8fa00465a6b16bda934a7e3c12e008aa2ed9d9e2ae31d3faca0ab94ada86 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44376083,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-containers/startup-script@sha256:be96df6845a2af0eb61b17817ed085ce41048e4044c541da7580570b61beff3e gcr.io/google-containers/startup-script:v1],SizeBytes:12528443,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:a295107679b0d92cb70145fc18fb53c76e79fceed7e1cf10ed763c7c102c5ebe alpine:3.12],SizeBytes:5577287,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 11 20:52:55.184: INFO: Logging kubelet events for node node1 Mar 11 20:52:55.189: INFO: Logging pods the kubelet thinks is on node node1 Mar 11 20:52:55.209: INFO: cmk-webhook-888945845-2gpfq started at 2021-03-11 18:03:34 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.209: INFO: Container cmk-webhook ready: true, restart count 0 Mar 11 20:52:55.209: INFO: node-exporter-mw629 started at 2021-03-11 18:04:28 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.209: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.209: INFO: Container node-exporter ready: true, restart count 0 Mar 11 20:52:55.209: INFO: iperf-e2e-pod-0 started at 2021-03-11 20:42:54 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.209: INFO: Container iperf-server ready: false, restart count 0 Mar 11 20:52:55.209: INFO: kube-proxy-5zz5g started at 2021-03-11 17:51:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.209: INFO: Container kube-proxy ready: true, restart count 2 Mar 11 20:52:55.209: INFO: kube-flannel-8pz9c started at 2021-03-11 17:52:37 +0000 UTC (1+1 container statuses recorded) Mar 11 20:52:55.209: INFO: Init container install-cni ready: true, restart count 0 Mar 11 20:52:55.209: INFO: Container kube-flannel ready: true, restart count 2 Mar 11 20:52:55.209: INFO: cmk-init-discover-node2-29mrv started at 2021-03-11 18:03:13 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.209: INFO: Container discover ready: false, restart count 0 Mar 11 20:52:55.209: INFO: Container init ready: false, restart count 0 Mar 11 20:52:55.209: INFO: Container install ready: false, restart count 0 Mar 11 20:52:55.209: INFO: collectd-4rvsd started at 2021-03-11 18:07:58 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.209: INFO: Container collectd ready: true, restart count 0 Mar 11 20:52:55.209: INFO: Container collectd-exporter ready: true, restart count 0 Mar 11 20:52:55.209: INFO: Container rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.209: INFO: nginx-proxy-node1 started at 2021-03-11 17:51:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.209: INFO: Container nginx-proxy ready: true, restart count 2 Mar 11 20:52:55.209: INFO: cmk-s6v97 started at 2021-03-11 18:03:34 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.209: INFO: Container nodereport ready: true, restart count 0 Mar 11 20:52:55.209: INFO: Container reconcile ready: true, restart count 0 Mar 11 20:52:55.209: INFO: prometheus-k8s-0 started at 2021-03-11 18:04:37 +0000 UTC (0+5 container statuses recorded) Mar 11 20:52:55.209: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Mar 11 20:52:55.209: INFO: Container grafana ready: true, restart count 0 Mar 11 20:52:55.209: INFO: Container prometheus ready: true, restart count 1 Mar 11 20:52:55.209: INFO: Container prometheus-config-reloader ready: true, restart count 0 Mar 11 20:52:55.209: INFO: Container rules-configmap-reloader ready: true, restart count 0 Mar 11 20:52:55.209: INFO: kube-multus-ds-amd64-gtmmz started at 2021-03-11 17:52:47 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.209: INFO: Container kube-multus ready: true, restart count 1 Mar 11 20:52:55.209: INFO: node-feature-discovery-worker-nf56t started at 2021-03-11 17:58:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.209: INFO: Container nfd-worker ready: true, restart count 0 Mar 11 20:52:55.209: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vf8xv started at 2021-03-11 18:00:01 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.209: INFO: Container kube-sriovdp ready: true, restart count 0 Mar 11 20:52:55.246: INFO: Latency metrics for node node1 Mar 11 20:52:55.246: INFO: Logging node info for node node2 Mar 11 20:52:55.249: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 48280382-daca-4d2c-a30b-cd693b7dd3e5 63283 0 2021-03-11 17:51:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.15.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.minor: kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"02:6c:14:b4:02:16"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major,system-os_release.VERSION_ID.minor nfd.node.kubernetes.io/worker.version:v0.5.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-03-11 17:51:58 +0000 UTC FieldsV1 FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 111 100 101 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 116 116 108 34 58 123 125 125 125 44 34 102 58 115 112 101 99 34 58 123 34 102 58 112 111 100 67 73 68 82 34 58 123 125 44 34 102 58 112 111 100 67 73 68 82 115 34 58 123 34 46 34 58 123 125 44 34 118 58 92 34 49 48 46 50 52 52 46 52 46 48 47 50 52 92 34 34 58 123 125 125 125 125],}} {kubeadm Update v1 2021-03-11 17:51:59 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 107 117 98 101 97 100 109 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 114 105 45 115 111 99 107 101 116 34 58 123 125 125 125 125],}} {flanneld Update v1 2021-03-11 17:54:35 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 100 97 116 97 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 116 121 112 101 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 107 117 98 101 45 115 117 98 110 101 116 45 109 97 110 97 103 101 114 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 112 117 98 108 105 99 45 105 112 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 78 101 116 119 111 114 107 85 110 97 118 97 105 108 97 98 108 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 125 125],}} {nfd-master Update v1 2021-03-11 17:59:05 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 102 100 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 102 101 97 116 117 114 101 45 108 97 98 101 108 115 34 58 123 125 44 34 102 58 110 102 100 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 119 111 114 107 101 114 46 118 101 114 115 105 111 110 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 68 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 69 83 78 73 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 50 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 66 87 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 67 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 68 81 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 70 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 86 76 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 70 77 65 51 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 72 76 69 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 73 66 80 66 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 77 80 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 82 84 77 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 83 84 73 66 80 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 86 77 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 104 97 114 100 119 97 114 101 95 109 117 108 116 105 116 104 114 101 97 100 105 110 103 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 112 115 116 97 116 101 46 116 117 114 98 111 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 67 77 84 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 76 51 67 65 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 66 65 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 66 77 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 79 78 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 99 111 110 102 105 103 46 78 79 95 72 90 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 99 111 110 102 105 103 46 78 79 95 72 90 95 70 85 76 76 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 115 101 108 105 110 117 120 46 101 110 97 98 108 101 100 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 102 117 108 108 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 109 97 106 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 109 105 110 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 114 101 118 105 115 105 111 110 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 101 109 111 114 121 45 110 117 109 97 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 110 101 116 119 111 114 107 45 115 114 105 111 118 46 99 97 112 97 98 108 101 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 110 101 116 119 111 114 107 45 115 114 105 111 118 46 99 111 110 102 105 103 117 114 101 100 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 112 99 105 45 48 51 48 48 95 49 97 48 51 46 112 114 101 115 101 110 116 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 116 111 114 97 103 101 45 110 111 110 114 111 116 97 116 105 111 110 97 108 100 105 115 107 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 73 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 46 109 97 106 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 46 109 105 110 111 114 34 58 123 125 125 125 125],}} {Swagger-Codegen Update v1 2021-03-11 18:01:45 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 99 109 107 45 110 111 100 101 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 101 120 99 108 117 115 105 118 101 45 99 111 114 101 115 34 58 123 125 125 125 125],}} {kubelet Update v1 2021-03-11 20:52:45 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 102 58 118 111 108 117 109 101 115 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 111 110 116 114 111 108 108 101 114 45 109 97 110 97 103 101 100 45 97 116 116 97 99 104 45 100 101 116 97 99 104 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 46 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 104 111 115 116 110 97 109 101 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 97 100 100 114 101 115 115 101 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 72 111 115 116 110 97 109 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 73 110 116 101 114 110 97 108 73 80 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 97 108 108 111 99 97 116 97 98 108 101 34 58 123 34 46 34 58 123 125 44 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 101 120 99 108 117 115 105 118 101 45 99 111 114 101 115 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 105 110 116 101 108 46 99 111 109 47 105 110 116 101 108 95 115 114 105 111 118 95 110 101 116 100 101 118 105 99 101 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 105 110 116 101 108 46 99 111 109 47 105 110 116 101 108 95 115 114 105 111 118 95 110 101 116 100 101 118 105 99 101 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 68 105 115 107 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 77 101 109 111 114 121 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 80 73 68 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 82 101 97 100 121 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 100 97 101 109 111 110 69 110 100 112 111 105 110 116 115 34 58 123 34 102 58 107 117 98 101 108 101 116 69 110 100 112 111 105 110 116 34 58 123 34 102 58 80 111 114 116 34 58 123 125 125 125 44 34 102 58 105 109 97 103 101 115 34 58 123 125 44 34 102 58 110 111 100 101 73 110 102 111 34 58 123 34 102 58 97 114 99 104 105 116 101 99 116 117 114 101 34 58 123 125 44 34 102 58 98 111 111 116 73 68 34 58 123 125 44 34 102 58 99 111 110 116 97 105 110 101 114 82 117 110 116 105 109 101 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 101 114 110 101 108 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 80 114 111 120 121 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 108 101 116 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 109 97 99 104 105 110 101 73 68 34 58 123 125 44 34 102 58 111 112 101 114 97 116 105 110 103 83 121 115 116 101 109 34 58 123 125 44 34 102 58 111 115 73 109 97 103 101 34 58 123 125 44 34 102 58 115 121 115 116 101 109 85 85 73 68 34 58 123 125 125 125 125],}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201259671552 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178911977472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-03-11 17:54:35 +0000 UTC,LastTransitionTime:2021-03-11 17:54:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:58:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:08627116483a4bf79f59d79a4a11d6f4,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:1be00882-edae-44a0-a65e-9f92c05d8856,KernelVersion:3.10.0-1160.15.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.12,KubeletVersion:v1.18.8,KubeProxyVersion:v1.18.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[opnfv/barometer-collectd@sha256:18abffcf9afb2c3cb0afac67de5f1317f7dcd8925906c434f4e18812d9efbb54],SizeBytes:1727353823,},ContainerImage{Names:[localhost:30500/cmk@sha256:fdd523af421b0b21e1d9a0699b629bc50687a7de7dcea78afe470b8eaeed4ae2 localhost:30500/cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:38cd3fe450dcded05650b49cd4c95b41fce97503892b5b760e9395d127bdf276 kubernetesui/dashboard-amd64:v2.0.2],SizeBytes:224634189,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:e9071531a6aa14fe50d882a68f10ee710d5203dd4bb07ff7a87d29cdc5a1fd5b k8s.gcr.io/kube-apiserver:v1.18.8],SizeBytes:173029757,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:8a2b2a8d3e586afdd223e096ab65db865d6dce680336f0b9f0d764b21abba06f k8s.gcr.io/kube-controller-manager:v1.18.8],SizeBytes:162425213,},ContainerImage{Names:[nginx@sha256:f3693fe50d5b1df1ecd315d54813a77afd56b0245a404055a946574deb6b34fc nginx:1.19],SizeBytes:133050457,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:6f6bd5c06680713d1047f7e27794c7c7d11e6859de5787dd4ca17d204669e683 k8s.gcr.io/kube-proxy:v1.18.8],SizeBytes:117264685,},ContainerImage{Names:[us.gcr.io/k8s-artifacts-prod/e2e-test-images/agnhost@sha256:1d7f0d77a6f07fd507f147a38d06a7c8269ebabd4f923bfe46d4fb8b396a520c us.gcr.io/k8s-artifacts-prod/e2e-test-images/agnhost:2.12],SizeBytes:111705925,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:ec7c376c780a3dd02d7e5850a0ca3d09fc8df50ac3ceb37a2214d403585361a0 k8s.gcr.io/kube-scheduler:v1.18.8],SizeBytes:95308157,},ContainerImage{Names:[quay.io/kubernetes_incubator/node-feature-discovery@sha256:99fe53b4555e717de68505ec46a10bc0e19c5e0d998fde5035bb623a65c75916 quay.io/kubernetes_incubator/node-feature-discovery:v0.5.0],SizeBytes:86455274,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:6d451d92c921f14bfb38196aacb6e506d4593c5b3c9d40a8b8a2506010dc3e10 quay.io/coreos/flannel:v0.12.0],SizeBytes:52767393,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[lachlanevenson/k8s-helm@sha256:dcf2036282694c6bfe2a533636dd8f494f63186b98e4118e741be04a9115af6a lachlanevenson/k8s-helm:v3.2.3],SizeBytes:46479395,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:0ebc8fa00465a6b16bda934a7e3c12e008aa2ed9d9e2ae31d3faca0ab94ada86 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44376083,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:a7f6555decef3c061cfb669be5137d2209690cafe459204126e01276f113b9af kubernetesui/metrics-scraper:v1.0.5],SizeBytes:36703493,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:0a63703fc308c6cb4207a707146ef234ff92011ee350289beec821e9a2c42765 localhost:30500/tas-controller:0.1],SizeBytes:23811271,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:96cd5db59860a84139d8d35c2e7662504a7c6cba7810831ed9374e0ddd9b1333 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/regression-issue-74839-amd64@sha256:3b36bd80b97c532a774e7f6246797b8575d97037982f353476c703ba6686c75c gcr.io/kubernetes-e2e-test-images/regression-issue-74839-amd64:1.0],SizeBytes:19227369,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 11 20:52:55.250: INFO: Logging kubelet events for node node2 Mar 11 20:52:55.253: INFO: Logging pods the kubelet thinks is on node node2 Mar 11 20:52:55.285: INFO: kube-flannel-8wwvj started at 2021-03-11 17:52:37 +0000 UTC (1+1 container statuses recorded) Mar 11 20:52:55.285: INFO: Init container install-cni ready: true, restart count 0 Mar 11 20:52:55.285: INFO: Container kube-flannel ready: true, restart count 2 Mar 11 20:52:55.285: INFO: node-exporter-x6vqx started at 2021-03-11 18:04:28 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.285: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.285: INFO: Container node-exporter ready: true, restart count 0 Mar 11 20:52:55.285: INFO: collectd-86ww6 started at 2021-03-11 18:07:58 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.285: INFO: Container collectd ready: true, restart count 0 Mar 11 20:52:55.285: INFO: Container collectd-exporter ready: true, restart count 0 Mar 11 20:52:55.285: INFO: Container rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.285: INFO: node-feature-discovery-worker-8xdg7 started at 2021-03-11 17:58:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.285: INFO: Container nfd-worker ready: true, restart count 0 Mar 11 20:52:55.285: INFO: kube-multus-ds-amd64-rpm89 started at 2021-03-11 17:52:47 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.285: INFO: Container kube-multus ready: true, restart count 1 Mar 11 20:52:55.285: INFO: prometheus-operator-f66f5fb4d-f2pkm started at 2021-03-11 18:04:21 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.285: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.285: INFO: Container prometheus-operator ready: true, restart count 0 Mar 11 20:52:55.285: INFO: kube-proxy-znx8n started at 2021-03-11 17:51:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.285: INFO: Container kube-proxy ready: true, restart count 1 Mar 11 20:52:55.285: INFO: cmk-init-discover-node2-c5j6h started at 2021-03-11 18:02:02 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.285: INFO: Container discover ready: false, restart count 0 Mar 11 20:52:55.285: INFO: Container init ready: false, restart count 0 Mar 11 20:52:55.285: INFO: Container install ready: false, restart count 0 Mar 11 20:52:55.285: INFO: cmk-init-discover-node2-qbc6m started at 2021-03-11 18:02:53 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.285: INFO: Container discover ready: false, restart count 0 Mar 11 20:52:55.285: INFO: Container init ready: false, restart count 0 Mar 11 20:52:55.285: INFO: Container install ready: false, restart count 0 Mar 11 20:52:55.285: INFO: tas-telemetry-aware-scheduling-5ffb6fd745-wqfmz started at 2021-03-11 18:07:22 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.285: INFO: Container tas-controller ready: true, restart count 0 Mar 11 20:52:55.285: INFO: Container tas-extender ready: true, restart count 0 Mar 11 20:52:55.285: INFO: cmk-slzjv started at 2021-03-11 18:03:33 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.285: INFO: Container nodereport ready: true, restart count 0 Mar 11 20:52:55.285: INFO: Container reconcile ready: true, restart count 0 Mar 11 20:52:55.285: INFO: kubernetes-dashboard-57777fbdcb-zsnff started at 2021-03-11 17:53:12 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.285: INFO: Container kubernetes-dashboard ready: true, restart count 1 Mar 11 20:52:55.285: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-ptgh4 started at 2021-03-11 18:00:01 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.285: INFO: Container kube-sriovdp ready: true, restart count 0 Mar 11 20:52:55.285: INFO: cmk-init-discover-node2-9knwq started at 2021-03-11 18:02:23 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.285: INFO: Container discover ready: false, restart count 0 Mar 11 20:52:55.285: INFO: Container init ready: false, restart count 0 Mar 11 20:52:55.285: INFO: Container install ready: false, restart count 0 Mar 11 20:52:55.285: INFO: cmk-init-discover-node1-vk7wm started at 2021-03-11 18:01:40 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.285: INFO: Container discover ready: false, restart count 0 Mar 11 20:52:55.285: INFO: Container init ready: false, restart count 0 Mar 11 20:52:55.285: INFO: Container install ready: false, restart count 0 Mar 11 20:52:55.285: INFO: nginx-proxy-node2 started at 2021-03-11 17:51:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.285: INFO: Container nginx-proxy ready: true, restart count 2 Mar 11 20:52:55.285: INFO: kubernetes-metrics-scraper-54fbb4d595-dq4gp started at 2021-03-11 17:53:12 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.285: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 Mar 11 20:52:55.324: INFO: Latency metrics for node node2 Mar 11 20:52:55.324: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "network-perf-593" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/no_snat.go:136 Mar 11 20:52:55.525: Unexpected error: <*errors.errorString | 0xc0038beed0>: { s: "did not find ExternalIP on Node", } did not find ExternalIP on Node occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/no_snat.go:172 [BeforeEach] [sig-network] NoSNAT [Feature:NoSNAT] [Slow] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:178 STEP: Creating a kubernetes client Mar 11 20:52:55.352: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename no-snat-test STEP: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in no-snat-test-5551 STEP: Waiting for a default service account to be provisioned in namespace [It] Should be able to send traffic between Pods without SNAT /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/no_snat.go:136 STEP: creating a test pod on each Node STEP: creating a no-snat-test-proxy Pod on Node master1 port 31235 so we can target our test Pods through this Node's ExternalIP Mar 11 20:52:55.525: FAIL: Unexpected error: <*errors.errorString | 0xc0038beed0>: { s: "did not find ExternalIP on Node", } did not find ExternalIP on Node occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func19.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/no_snat.go:172 +0x69d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001d58100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:125 +0x324 k8s.io/kubernetes/test/e2e.TestE2E(0xc001d58100) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:111 +0x2b testing.tRunner(0xc001d58100, 0x4afad60) /usr/local/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /usr/local/go/src/testing/testing.go:960 +0x350 [AfterEach] [sig-network] NoSNAT [Feature:NoSNAT] [Slow] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:179 STEP: Collecting events from namespace "no-snat-test-5551". STEP: Found 0 events. Mar 11 20:52:55.531: INFO: POD NODE PHASE GRACE CONDITIONS Mar 11 20:52:55.531: INFO: no-snat-test5tz7d node2 Pending [] Mar 11 20:52:55.531: INFO: no-snat-testq4wlg master3 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC ContainersNotReady containers with unready status: [no-snat-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC ContainersNotReady containers with unready status: [no-snat-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC }] Mar 11 20:52:55.531: INFO: no-snat-testsq5mp master2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC ContainersNotReady containers with unready status: [no-snat-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC ContainersNotReady containers with unready status: [no-snat-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC }] Mar 11 20:52:55.531: INFO: no-snat-testtf5fx master1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC ContainersNotReady containers with unready status: [no-snat-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC ContainersNotReady containers with unready status: [no-snat-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC }] Mar 11 20:52:55.531: INFO: no-snat-testvfnz2 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC ContainersNotReady containers with unready status: [no-snat-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC ContainersNotReady containers with unready status: [no-snat-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-03-11 20:52:55 +0000 UTC }] Mar 11 20:52:55.531: INFO: Mar 11 20:52:55.535: INFO: Logging node info for node master1 Mar 11 20:52:55.537: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 bc51b401-422a-4e82-b449-caa7cdc72ceb 63300 0 2021-03-11 17:50:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0e:0e:ac:80:fe:e5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-03-11 17:50:19 +0000 UTC FieldsV1 FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 107 117 98 101 97 100 109 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 114 105 45 115 111 99 107 101 116 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 110 111 100 101 45 114 111 108 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 97 115 116 101 114 34 58 123 125 125 125 125],}} {kube-controller-manager Update v1 2021-03-11 17:52:41 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 111 100 101 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 116 116 108 34 58 123 125 125 125 44 34 102 58 115 112 101 99 34 58 123 34 102 58 112 111 100 67 73 68 82 34 58 123 125 44 34 102 58 112 111 100 67 73 68 82 115 34 58 123 34 46 34 58 123 125 44 34 118 58 92 34 49 48 46 50 52 52 46 48 46 48 47 50 52 92 34 34 58 123 125 125 44 34 102 58 116 97 105 110 116 115 34 58 123 125 125 125],}} {flanneld Update v1 2021-03-11 17:54:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 100 97 116 97 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 116 121 112 101 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 107 117 98 101 45 115 117 98 110 101 116 45 109 97 110 97 103 101 114 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 112 117 98 108 105 99 45 105 112 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 78 101 116 119 111 114 107 85 110 97 118 97 105 108 97 98 108 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 125 125],}} {kubelet Update v1 2021-03-11 20:52:50 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 102 58 118 111 108 117 109 101 115 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 111 110 116 114 111 108 108 101 114 45 109 97 110 97 103 101 100 45 97 116 116 97 99 104 45 100 101 116 97 99 104 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 46 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 104 111 115 116 110 97 109 101 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 97 100 100 114 101 115 115 101 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 72 111 115 116 110 97 109 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 73 110 116 101 114 110 97 108 73 80 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 97 108 108 111 99 97 116 97 98 108 101 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 68 105 115 107 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 77 101 109 111 114 121 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 80 73 68 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 82 101 97 100 121 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 100 97 101 109 111 110 69 110 100 112 111 105 110 116 115 34 58 123 34 102 58 107 117 98 101 108 101 116 69 110 100 112 111 105 110 116 34 58 123 34 102 58 80 111 114 116 34 58 123 125 125 125 44 34 102 58 105 109 97 103 101 115 34 58 123 125 44 34 102 58 110 111 100 101 73 110 102 111 34 58 123 34 102 58 97 114 99 104 105 116 101 99 116 117 114 101 34 58 123 125 44 34 102 58 98 111 111 116 73 68 34 58 123 125 44 34 102 58 99 111 110 116 97 105 110 101 114 82 117 110 116 105 109 101 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 101 114 110 101 108 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 80 114 111 120 121 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 108 101 116 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 109 97 99 104 105 110 101 73 68 34 58 123 125 44 34 102 58 111 112 101 114 97 116 105 110 103 83 121 115 116 101 109 34 58 123 125 44 34 102 58 111 115 73 109 97 103 101 34 58 123 125 44 34 102 58 115 121 115 116 101 109 85 85 73 68 34 58 123 125 125 125 125],}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234776064 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200361918464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-03-11 17:54:32 +0000 UTC,LastTransitionTime:2021-03-11 17:54:32 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:52:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0cb21bb9b8b64bf38523b2f5a8bdad14,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:4a77cc46-4c80-409c-8c40-c24648f76e32,KernelVersion:3.10.0-1160.15.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.12,KubeletVersion:v1.18.8,KubeProxyVersion:v1.18.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:38cd3fe450dcded05650b49cd4c95b41fce97503892b5b760e9395d127bdf276 kubernetesui/dashboard-amd64:v2.0.2],SizeBytes:224634189,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:e9071531a6aa14fe50d882a68f10ee710d5203dd4bb07ff7a87d29cdc5a1fd5b k8s.gcr.io/kube-apiserver:v1.18.8],SizeBytes:173029757,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:8a2b2a8d3e586afdd223e096ab65db865d6dce680336f0b9f0d764b21abba06f k8s.gcr.io/kube-controller-manager:v1.18.8],SizeBytes:162425213,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:6f6bd5c06680713d1047f7e27794c7c7d11e6859de5787dd4ca17d204669e683 k8s.gcr.io/kube-proxy:v1.18.8],SizeBytes:117264685,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:ec7c376c780a3dd02d7e5850a0ca3d09fc8df50ac3ceb37a2214d403585361a0 k8s.gcr.io/kube-scheduler:v1.18.8],SizeBytes:95308157,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:41ed47389c835eb68215e8215f6d4bfa5123923afd7550dbae049cded27c41b4 quay.io/coreos/etcd:v3.4.3],SizeBytes:83576774,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:6d451d92c921f14bfb38196aacb6e506d4593c5b3c9d40a8b8a2506010dc3e10 quay.io/coreos/flannel:v0.12.0],SizeBytes:52767393,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[lachlanevenson/k8s-helm@sha256:dcf2036282694c6bfe2a533636dd8f494f63186b98e4118e741be04a9115af6a lachlanevenson/k8s-helm:v3.2.3],SizeBytes:46479395,},ContainerImage{Names:[coredns/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c coredns/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:40684734,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:a7f6555decef3c061cfb669be5137d2209690cafe459204126e01276f113b9af kubernetesui/metrics-scraper:v1.0.5],SizeBytes:36703493,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:0a63703fc308c6cb4207a707146ef234ff92011ee350289beec821e9a2c42765 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:23811271,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:96cd5db59860a84139d8d35c2e7662504a7c6cba7810831ed9374e0ddd9b1333 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5617799,},ContainerImage{Names:[alpine@sha256:a75afd8b57e7f34e4dad8d65e2c7ba2e1975c795ce1ee22fa34f8cf46f96a3be alpine:latest],SizeBytes:5613158,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 11 20:52:55.538: INFO: Logging kubelet events for node master1 Mar 11 20:52:55.542: INFO: Logging pods the kubelet thinks is on node master1 Mar 11 20:52:55.550: INFO: kube-controller-manager-master1 started at 2021-03-11 17:57:56 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.550: INFO: Container kube-controller-manager ready: true, restart count 1 Mar 11 20:52:55.550: INFO: kube-proxy-bwz9p started at 2021-03-11 17:51:51 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.550: INFO: Container kube-proxy ready: true, restart count 1 Mar 11 20:52:55.550: INFO: kube-flannel-pzw7v started at 2021-03-11 17:52:37 +0000 UTC (1+1 container statuses recorded) Mar 11 20:52:55.550: INFO: Init container install-cni ready: true, restart count 2 Mar 11 20:52:55.550: INFO: Container kube-flannel ready: true, restart count 1 Mar 11 20:52:55.550: INFO: kube-scheduler-master1 started at 2021-03-11 18:07:23 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.550: INFO: Container kube-scheduler ready: true, restart count 1 Mar 11 20:52:55.550: INFO: kube-apiserver-master1 started at 2021-03-11 17:51:21 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.550: INFO: Container kube-apiserver ready: true, restart count 0 Mar 11 20:52:55.550: INFO: kube-multus-ds-amd64-2jdtx started at 2021-03-11 17:52:47 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.550: INFO: Container kube-multus ready: true, restart count 1 Mar 11 20:52:55.550: INFO: docker-registry-docker-registry-6d4484d8f9-pkjwp started at 2021-03-11 17:55:49 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.550: INFO: Container docker-registry ready: true, restart count 0 Mar 11 20:52:55.550: INFO: Container nginx ready: true, restart count 0 Mar 11 20:52:55.550: INFO: node-exporter-b54mc started at 2021-03-11 18:04:28 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.550: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.550: INFO: Container node-exporter ready: true, restart count 0 Mar 11 20:52:55.550: INFO: coredns-59dcc4799b-qsq4q started at 2021-03-11 20:35:16 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.550: INFO: Container coredns ready: true, restart count 0 Mar 11 20:52:55.550: INFO: no-snat-testtf5fx started at 2021-03-11 20:52:55 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.550: INFO: Container no-snat-test ready: false, restart count 0 Mar 11 20:52:55.584: INFO: Latency metrics for node master1 Mar 11 20:52:55.584: INFO: Logging node info for node master2 Mar 11 20:52:55.586: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 81d12a4f-6154-421a-896a-6071517cc7cf 63295 0 2021-03-11 17:50:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"8a:67:dc:b1:33:9d"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-03-11 17:50:55 +0000 UTC FieldsV1 FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 107 117 98 101 97 100 109 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 114 105 45 115 111 99 107 101 116 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 110 111 100 101 45 114 111 108 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 97 115 116 101 114 34 58 123 125 125 125 125],}} {kube-controller-manager Update v1 2021-03-11 17:52:41 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 111 100 101 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 116 116 108 34 58 123 125 125 125 44 34 102 58 115 112 101 99 34 58 123 34 102 58 112 111 100 67 73 68 82 34 58 123 125 44 34 102 58 112 111 100 67 73 68 82 115 34 58 123 34 46 34 58 123 125 44 34 118 58 92 34 49 48 46 50 52 52 46 50 46 48 47 50 52 92 34 34 58 123 125 125 44 34 102 58 116 97 105 110 116 115 34 58 123 125 125 125],}} {flanneld Update v1 2021-03-11 17:54:35 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 100 97 116 97 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 116 121 112 101 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 107 117 98 101 45 115 117 98 110 101 116 45 109 97 110 97 103 101 114 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 112 117 98 108 105 99 45 105 112 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 78 101 116 119 111 114 107 85 110 97 118 97 105 108 97 98 108 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 125 125],}} {kubelet Update v1 2021-03-11 20:52:50 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 102 58 118 111 108 117 109 101 115 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 111 110 116 114 111 108 108 101 114 45 109 97 110 97 103 101 100 45 97 116 116 97 99 104 45 100 101 116 97 99 104 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 46 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 104 111 115 116 110 97 109 101 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 97 100 100 114 101 115 115 101 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 72 111 115 116 110 97 109 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 73 110 116 101 114 110 97 108 73 80 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 97 108 108 111 99 97 116 97 98 108 101 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 68 105 115 107 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 77 101 109 111 114 121 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 80 73 68 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 82 101 97 100 121 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 100 97 101 109 111 110 69 110 100 112 111 105 110 116 115 34 58 123 34 102 58 107 117 98 101 108 101 116 69 110 100 112 111 105 110 116 34 58 123 34 102 58 80 111 114 116 34 58 123 125 125 125 44 34 102 58 105 109 97 103 101 115 34 58 123 125 44 34 102 58 110 111 100 101 73 110 102 111 34 58 123 34 102 58 97 114 99 104 105 116 101 99 116 117 114 101 34 58 123 125 44 34 102 58 98 111 111 116 73 68 34 58 123 125 44 34 102 58 99 111 110 116 97 105 110 101 114 82 117 110 116 105 109 101 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 101 114 110 101 108 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 80 114 111 120 121 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 108 101 116 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 109 97 99 104 105 110 101 73 68 34 58 123 125 44 34 102 58 111 112 101 114 97 116 105 110 103 83 121 115 116 101 109 34 58 123 125 44 34 102 58 111 115 73 109 97 103 101 34 58 123 125 44 34 102 58 115 121 115 116 101 109 85 85 73 68 34 58 123 125 125 125 125],}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234771968 0} {<nil>} 196518332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200361914368 0} {<nil>} 195665932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-03-11 17:54:35 +0000 UTC,LastTransitionTime:2021-03-11 17:54:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-03-11 20:52:50 +0000 UTC,LastTransitionTime:2021-03-11 17:52:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b3061860c4ba472e9c76577f315c0ddb,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:bc6d20a6-057d-4d5d-af80-cb65b29e2a9f,KernelVersion:3.10.0-1160.15.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.12,KubeletVersion:v1.18.8,KubeProxyVersion:v1.18.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:38cd3fe450dcded05650b49cd4c95b41fce97503892b5b760e9395d127bdf276 kubernetesui/dashboard-amd64:v2.0.2],SizeBytes:224634189,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:e9071531a6aa14fe50d882a68f10ee710d5203dd4bb07ff7a87d29cdc5a1fd5b k8s.gcr.io/kube-apiserver:v1.18.8],SizeBytes:173029757,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:8a2b2a8d3e586afdd223e096ab65db865d6dce680336f0b9f0d764b21abba06f k8s.gcr.io/kube-controller-manager:v1.18.8],SizeBytes:162425213,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:6f6bd5c06680713d1047f7e27794c7c7d11e6859de5787dd4ca17d204669e683 k8s.gcr.io/kube-proxy:v1.18.8],SizeBytes:117264685,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:ec7c376c780a3dd02d7e5850a0ca3d09fc8df50ac3ceb37a2214d403585361a0 k8s.gcr.io/kube-scheduler:v1.18.8],SizeBytes:95308157,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:41ed47389c835eb68215e8215f6d4bfa5123923afd7550dbae049cded27c41b4 quay.io/coreos/etcd:v3.4.3],SizeBytes:83576774,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:6d451d92c921f14bfb38196aacb6e506d4593c5b3c9d40a8b8a2506010dc3e10 quay.io/coreos/flannel:v0.12.0],SizeBytes:52767393,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[lachlanevenson/k8s-helm@sha256:dcf2036282694c6bfe2a533636dd8f494f63186b98e4118e741be04a9115af6a lachlanevenson/k8s-helm:v3.2.3],SizeBytes:46479395,},ContainerImage{Names:[coredns/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c coredns/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:40684734,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:a7f6555decef3c061cfb669be5137d2209690cafe459204126e01276f113b9af kubernetesui/metrics-scraper:v1.0.5],SizeBytes:36703493,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 11 20:52:55.587: INFO: Logging kubelet events for node master2 Mar 11 20:52:55.590: INFO: Logging pods the kubelet thinks is on node master2 Mar 11 20:52:55.600: INFO: kube-controller-manager-master2 started at 2021-03-11 17:57:56 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.600: INFO: Container kube-controller-manager ready: true, restart count 2 Mar 11 20:52:55.600: INFO: kube-scheduler-master2 started at 2021-03-11 17:57:56 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.600: INFO: Container kube-scheduler ready: true, restart count 2 Mar 11 20:52:55.600: INFO: kube-proxy-qg4j5 started at 2021-03-11 17:51:51 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.600: INFO: Container kube-proxy ready: true, restart count 1 Mar 11 20:52:55.600: INFO: kube-flannel-kfjhn started at 2021-03-11 17:52:37 +0000 UTC (1+1 container statuses recorded) Mar 11 20:52:55.600: INFO: Init container install-cni ready: true, restart count 0 Mar 11 20:52:55.600: INFO: Container kube-flannel ready: true, restart count 2 Mar 11 20:52:55.600: INFO: kube-multus-ds-amd64-xx6h7 started at 2021-03-11 17:52:47 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.600: INFO: Container kube-multus ready: true, restart count 1 Mar 11 20:52:55.600: INFO: node-exporter-j8bwb started at 2021-03-11 18:04:28 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.600: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.600: INFO: Container node-exporter ready: true, restart count 0 Mar 11 20:52:55.600: INFO: no-snat-testsq5mp started at 2021-03-11 20:52:55 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.600: INFO: Container no-snat-test ready: false, restart count 0 Mar 11 20:52:55.600: INFO: kube-apiserver-master2 started at 2021-03-11 17:54:26 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.600: INFO: Container kube-apiserver ready: true, restart count 0 Mar 11 20:52:55.627: INFO: Latency metrics for node master2 Mar 11 20:52:55.627: INFO: Logging node info for node master3 Mar 11 20:52:55.629: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 2ec4f135-9e61-46a6-a537-0ad6199eddb1 63301 0 2021-03-11 17:50:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:4a:32:07:d3:68"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.5.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-03-11 17:50:55 +0000 UTC FieldsV1 FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 107 117 98 101 97 100 109 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 114 105 45 115 111 99 107 101 116 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 110 111 100 101 45 114 111 108 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 97 115 116 101 114 34 58 123 125 125 125 125],}} {kube-controller-manager Update v1 2021-03-11 17:52:41 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 111 100 101 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 116 116 108 34 58 123 125 125 125 44 34 102 58 115 112 101 99 34 58 123 34 102 58 112 111 100 67 73 68 82 34 58 123 125 44 34 102 58 112 111 100 67 73 68 82 115 34 58 123 34 46 34 58 123 125 44 34 118 58 92 34 49 48 46 50 52 52 46 49 46 48 47 50 52 92 34 34 58 123 125 125 44 34 102 58 116 97 105 110 116 115 34 58 123 125 125 125],}} {flanneld Update v1 2021-03-11 17:54:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 100 97 116 97 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 116 121 112 101 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 107 117 98 101 45 115 117 98 110 101 116 45 109 97 110 97 103 101 114 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 112 117 98 108 105 99 45 105 112 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 78 101 116 119 111 114 107 85 110 97 118 97 105 108 97 98 108 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 125 125],}} {nfd-master Update v1 2021-03-11 17:59:05 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 102 100 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 97 115 116 101 114 46 118 101 114 115 105 111 110 34 58 123 125 125 125 125],}} {kubelet Update v1 2021-03-11 20:52:51 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 102 58 118 111 108 117 109 101 115 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 111 110 116 114 111 108 108 101 114 45 109 97 110 97 103 101 100 45 97 116 116 97 99 104 45 100 101 116 97 99 104 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 46 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 104 111 115 116 110 97 109 101 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 97 100 100 114 101 115 115 101 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 72 111 115 116 110 97 109 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 73 110 116 101 114 110 97 108 73 80 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 97 108 108 111 99 97 116 97 98 108 101 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 68 105 115 107 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 77 101 109 111 114 121 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 80 73 68 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 82 101 97 100 121 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 100 97 101 109 111 110 69 110 100 112 111 105 110 116 115 34 58 123 34 102 58 107 117 98 101 108 101 116 69 110 100 112 111 105 110 116 34 58 123 34 102 58 80 111 114 116 34 58 123 125 125 125 44 34 102 58 105 109 97 103 101 115 34 58 123 125 44 34 102 58 110 111 100 101 73 110 102 111 34 58 123 34 102 58 97 114 99 104 105 116 101 99 116 117 114 101 34 58 123 125 44 34 102 58 98 111 111 116 73 68 34 58 123 125 44 34 102 58 99 111 110 116 97 105 110 101 114 82 117 110 116 105 109 101 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 101 114 110 101 108 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 80 114 111 120 121 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 108 101 116 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 109 97 99 104 105 110 101 73 68 34 58 123 125 44 34 102 58 111 112 101 114 97 116 105 110 103 83 121 115 116 101 109 34 58 123 125 44 34 102 58 111 115 73 109 97 103 101 34 58 123 125 44 34 102 58 115 121 115 116 101 109 85 85 73 68 34 58 123 125 125 125 125],}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234776064 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200361918464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-03-11 17:54:32 +0000 UTC,LastTransitionTime:2021-03-11 17:54:32 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:51 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:51 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:51 +0000 UTC,LastTransitionTime:2021-03-11 17:50:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-03-11 20:52:51 +0000 UTC,LastTransitionTime:2021-03-11 17:54:26 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4167bf4cb2634ca88fc2626bbda0ce42,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:52af946c-b482-4940-ad01-ee4a9a06c438,KernelVersion:3.10.0-1160.15.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.12,KubeletVersion:v1.18.8,KubeProxyVersion:v1.18.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:38cd3fe450dcded05650b49cd4c95b41fce97503892b5b760e9395d127bdf276 kubernetesui/dashboard-amd64:v2.0.2],SizeBytes:224634189,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:e9071531a6aa14fe50d882a68f10ee710d5203dd4bb07ff7a87d29cdc5a1fd5b k8s.gcr.io/kube-apiserver:v1.18.8],SizeBytes:173029757,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:8a2b2a8d3e586afdd223e096ab65db865d6dce680336f0b9f0d764b21abba06f k8s.gcr.io/kube-controller-manager:v1.18.8],SizeBytes:162425213,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:6f6bd5c06680713d1047f7e27794c7c7d11e6859de5787dd4ca17d204669e683 k8s.gcr.io/kube-proxy:v1.18.8],SizeBytes:117264685,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:ec7c376c780a3dd02d7e5850a0ca3d09fc8df50ac3ceb37a2214d403585361a0 k8s.gcr.io/kube-scheduler:v1.18.8],SizeBytes:95308157,},ContainerImage{Names:[quay.io/kubernetes_incubator/node-feature-discovery@sha256:99fe53b4555e717de68505ec46a10bc0e19c5e0d998fde5035bb623a65c75916 quay.io/kubernetes_incubator/node-feature-discovery:v0.5.0],SizeBytes:86455274,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:41ed47389c835eb68215e8215f6d4bfa5123923afd7550dbae049cded27c41b4 quay.io/coreos/etcd:v3.4.3],SizeBytes:83576774,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:6d451d92c921f14bfb38196aacb6e506d4593c5b3c9d40a8b8a2506010dc3e10 quay.io/coreos/flannel:v0.12.0],SizeBytes:52767393,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[lachlanevenson/k8s-helm@sha256:dcf2036282694c6bfe2a533636dd8f494f63186b98e4118e741be04a9115af6a lachlanevenson/k8s-helm:v3.2.3],SizeBytes:46479395,},ContainerImage{Names:[coredns/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c coredns/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:40684734,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:a7f6555decef3c061cfb669be5137d2209690cafe459204126e01276f113b9af kubernetesui/metrics-scraper:v1.0.5],SizeBytes:36703493,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 11 20:52:55.629: INFO: Logging kubelet events for node master3 Mar 11 20:52:55.633: INFO: Logging pods the kubelet thinks is on node master3 Mar 11 20:52:55.643: INFO: kube-proxy-ktvzn started at 2021-03-11 17:51:51 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.643: INFO: Container kube-proxy ready: true, restart count 1 Mar 11 20:52:55.643: INFO: kube-flannel-fkd4q started at 2021-03-11 17:52:37 +0000 UTC (1+1 container statuses recorded) Mar 11 20:52:55.643: INFO: Init container install-cni ready: true, restart count 0 Mar 11 20:52:55.643: INFO: Container kube-flannel ready: true, restart count 1 Mar 11 20:52:55.643: INFO: kube-multus-ds-amd64-94kvc started at 2021-03-11 17:52:47 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.643: INFO: Container kube-multus ready: true, restart count 1 Mar 11 20:52:55.643: INFO: dns-autoscaler-66498f5c5f-m7mx4 started at 2021-03-11 17:53:11 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.643: INFO: Container autoscaler ready: true, restart count 1 Mar 11 20:52:55.643: INFO: kube-apiserver-master3 started at 2021-03-11 17:54:26 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.643: INFO: Container kube-apiserver ready: true, restart count 0 Mar 11 20:52:55.643: INFO: kube-controller-manager-master3 started at 2021-03-11 17:54:26 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.643: INFO: Container kube-controller-manager ready: true, restart count 2 Mar 11 20:52:55.643: INFO: kube-scheduler-master3 started at 2021-03-11 17:51:21 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.643: INFO: Container kube-scheduler ready: true, restart count 2 Mar 11 20:52:55.643: INFO: node-feature-discovery-controller-ccc948bcc-k5xj8 started at 2021-03-11 17:58:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.643: INFO: Container nfd-controller ready: true, restart count 0 Mar 11 20:52:55.643: INFO: node-exporter-xgq5j started at 2021-03-11 18:04:28 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.643: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.643: INFO: Container node-exporter ready: true, restart count 0 Mar 11 20:52:55.643: INFO: coredns-59dcc4799b-8wbvl started at 2021-03-11 20:35:16 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.643: INFO: Container coredns ready: true, restart count 0 Mar 11 20:52:55.643: INFO: no-snat-testq4wlg started at 2021-03-11 20:52:55 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.643: INFO: Container no-snat-test ready: false, restart count 0 Mar 11 20:52:55.673: INFO: Latency metrics for node master3 Mar 11 20:52:55.673: INFO: Logging node info for node node1 Mar 11 20:52:55.676: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 09564b93-d658-496c-8cb0-ca1148040536 63316 0 2021-03-11 17:51:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.15.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.minor: kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:2f:67:81:a9:4b"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major,system-os_release.VERSION_ID.minor nfd.node.kubernetes.io/worker.version:v0.5.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-03-11 17:51:58 +0000 UTC FieldsV1 FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 111 100 101 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 116 116 108 34 58 123 125 125 125 44 34 102 58 115 112 101 99 34 58 123 34 102 58 112 111 100 67 73 68 82 34 58 123 125 44 34 102 58 112 111 100 67 73 68 82 115 34 58 123 34 46 34 58 123 125 44 34 118 58 92 34 49 48 46 50 52 52 46 51 46 48 47 50 52 92 34 34 58 123 125 125 125 125],}} {kubeadm Update v1 2021-03-11 17:51:59 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 107 117 98 101 97 100 109 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 114 105 45 115 111 99 107 101 116 34 58 123 125 125 125 125],}} {flanneld Update v1 2021-03-11 17:54:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 100 97 116 97 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 116 121 112 101 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 107 117 98 101 45 115 117 98 110 101 116 45 109 97 110 97 103 101 114 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 112 117 98 108 105 99 45 105 112 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 78 101 116 119 111 114 107 85 110 97 118 97 105 108 97 98 108 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 125 125],}} {nfd-master Update v1 2021-03-11 17:59:05 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 102 100 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 102 101 97 116 117 114 101 45 108 97 98 101 108 115 34 58 123 125 44 34 102 58 110 102 100 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 119 111 114 107 101 114 46 118 101 114 115 105 111 110 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 68 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 69 83 78 73 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 50 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 66 87 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 67 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 68 81 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 70 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 86 76 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 70 77 65 51 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 72 76 69 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 73 66 80 66 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 77 80 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 82 84 77 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 83 84 73 66 80 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 86 77 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 104 97 114 100 119 97 114 101 95 109 117 108 116 105 116 104 114 101 97 100 105 110 103 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 112 115 116 97 116 101 46 116 117 114 98 111 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 67 77 84 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 76 51 67 65 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 66 65 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 66 77 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 79 78 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 99 111 110 102 105 103 46 78 79 95 72 90 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 99 111 110 102 105 103 46 78 79 95 72 90 95 70 85 76 76 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 115 101 108 105 110 117 120 46 101 110 97 98 108 101 100 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 102 117 108 108 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 109 97 106 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 109 105 110 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 114 101 118 105 115 105 111 110 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 101 109 111 114 121 45 110 117 109 97 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 110 101 116 119 111 114 107 45 115 114 105 111 118 46 99 97 112 97 98 108 101 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 110 101 116 119 111 114 107 45 115 114 105 111 118 46 99 111 110 102 105 103 117 114 101 100 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 112 99 105 45 48 51 48 48 95 49 97 48 51 46 112 114 101 115 101 110 116 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 116 111 114 97 103 101 45 110 111 110 114 111 116 97 116 105 111 110 97 108 100 105 115 107 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 73 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 46 109 97 106 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 46 109 105 110 111 114 34 58 123 125 125 125 125],}} {Swagger-Codegen Update v1 2021-03-11 18:03:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 99 109 107 45 110 111 100 101 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 101 120 99 108 117 115 105 118 101 45 99 111 114 101 115 34 58 123 125 125 125 125],}} {kubelet Update v1 2021-03-11 20:52:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 102 58 118 111 108 117 109 101 115 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 111 110 116 114 111 108 108 101 114 45 109 97 110 97 103 101 100 45 97 116 116 97 99 104 45 100 101 116 97 99 104 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 46 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 104 111 115 116 110 97 109 101 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 97 100 100 114 101 115 115 101 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 72 111 115 116 110 97 109 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 73 110 116 101 114 110 97 108 73 80 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 97 108 108 111 99 97 116 97 98 108 101 34 58 123 34 46 34 58 123 125 44 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 101 120 99 108 117 115 105 118 101 45 99 111 114 101 115 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 105 110 116 101 108 46 99 111 109 47 105 110 116 101 108 95 115 114 105 111 118 95 110 101 116 100 101 118 105 99 101 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 105 110 116 101 108 46 99 111 109 47 105 110 116 101 108 95 115 114 105 111 118 95 110 101 116 100 101 118 105 99 101 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 68 105 115 107 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 77 101 109 111 114 121 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 80 73 68 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 82 101 97 100 121 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 100 97 101 109 111 110 69 110 100 112 111 105 110 116 115 34 58 123 34 102 58 107 117 98 101 108 101 116 69 110 100 112 111 105 110 116 34 58 123 34 102 58 80 111 114 116 34 58 123 125 125 125 44 34 102 58 105 109 97 103 101 115 34 58 123 125 44 34 102 58 110 111 100 101 73 110 102 111 34 58 123 34 102 58 97 114 99 104 105 116 101 99 116 117 114 101 34 58 123 125 44 34 102 58 98 111 111 116 73 68 34 58 123 125 44 34 102 58 99 111 110 116 97 105 110 101 114 82 117 110 116 105 109 101 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 101 114 110 101 108 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 80 114 111 120 121 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 108 101 116 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 109 97 99 104 105 110 101 73 68 34 58 123 125 44 34 102 58 111 112 101 114 97 116 105 110 103 83 121 115 116 101 109 34 58 123 125 44 34 102 58 111 115 73 109 97 103 101 34 58 123 125 44 34 102 58 115 121 115 116 101 109 85 85 73 68 34 58 123 125 125 125 125],}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201259671552 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178911977472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-03-11 17:54:32 +0000 UTC,LastTransitionTime:2021-03-11 17:54:32 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:55 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:55 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:55 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-03-11 20:52:55 +0000 UTC,LastTransitionTime:2021-03-11 17:58:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14aafcebb52e4debae4bcb2b7efb6066,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:87cad20c-59df-4889-8b1c-8831f7bcac2e,KernelVersion:3.10.0-1160.15.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.12,KubeletVersion:v1.18.8,KubeProxyVersion:v1.18.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[opnfv/barometer-collectd@sha256:18abffcf9afb2c3cb0afac67de5f1317f7dcd8925906c434f4e18812d9efbb54],SizeBytes:1727353823,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002423280,},ContainerImage{Names:[localhost:30500/cmk@sha256:fdd523af421b0b21e1d9a0699b629bc50687a7de7dcea78afe470b8eaeed4ae2 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:5ae9a5d4f882cae1ddfb3aeb6c5c6645df57e77e3bdaf9083c3cde45c7f9cbc2 golang:alpine3.12],SizeBytes:301038054,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:e9071531a6aa14fe50d882a68f10ee710d5203dd4bb07ff7a87d29cdc5a1fd5b k8s.gcr.io/kube-apiserver:v1.18.8],SizeBytes:173029757,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:8a2b2a8d3e586afdd223e096ab65db865d6dce680336f0b9f0d764b21abba06f k8s.gcr.io/kube-controller-manager:v1.18.8],SizeBytes:162425213,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:f3693fe50d5b1df1ecd315d54813a77afd56b0245a404055a946574deb6b34fc nginx:1.19],SizeBytes:133050457,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:6f6bd5c06680713d1047f7e27794c7c7d11e6859de5787dd4ca17d204669e683 k8s.gcr.io/kube-proxy:v1.18.8],SizeBytes:117264685,},ContainerImage{Names:[us.gcr.io/k8s-artifacts-prod/e2e-test-images/agnhost@sha256:1d7f0d77a6f07fd507f147a38d06a7c8269ebabd4f923bfe46d4fb8b396a520c us.gcr.io/k8s-artifacts-prod/e2e-test-images/agnhost:2.12],SizeBytes:111705925,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:ec7c376c780a3dd02d7e5850a0ca3d09fc8df50ac3ceb37a2214d403585361a0 k8s.gcr.io/kube-scheduler:v1.18.8],SizeBytes:95308157,},ContainerImage{Names:[quay.io/kubernetes_incubator/node-feature-discovery@sha256:99fe53b4555e717de68505ec46a10bc0e19c5e0d998fde5035bb623a65c75916 quay.io/kubernetes_incubator/node-feature-discovery:v0.5.0],SizeBytes:86455274,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:6d451d92c921f14bfb38196aacb6e506d4593c5b3c9d40a8b8a2506010dc3e10 quay.io/coreos/flannel:v0.12.0],SizeBytes:52767393,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[lachlanevenson/k8s-helm@sha256:dcf2036282694c6bfe2a533636dd8f494f63186b98e4118e741be04a9115af6a lachlanevenson/k8s-helm:v3.2.3],SizeBytes:46479395,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:0ebc8fa00465a6b16bda934a7e3c12e008aa2ed9d9e2ae31d3faca0ab94ada86 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44376083,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-containers/startup-script@sha256:be96df6845a2af0eb61b17817ed085ce41048e4044c541da7580570b61beff3e gcr.io/google-containers/startup-script:v1],SizeBytes:12528443,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:a295107679b0d92cb70145fc18fb53c76e79fceed7e1cf10ed763c7c102c5ebe alpine:3.12],SizeBytes:5577287,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 11 20:52:55.677: INFO: Logging kubelet events for node node1 Mar 11 20:52:55.681: INFO: Logging pods the kubelet thinks is on node node1 Mar 11 20:52:55.693: INFO: nginx-proxy-node1 started at 2021-03-11 17:51:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.693: INFO: Container nginx-proxy ready: true, restart count 2 Mar 11 20:52:55.693: INFO: cmk-s6v97 started at 2021-03-11 18:03:34 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.693: INFO: Container nodereport ready: true, restart count 0 Mar 11 20:52:55.693: INFO: Container reconcile ready: true, restart count 0 Mar 11 20:52:55.693: INFO: no-snat-testvfnz2 started at 2021-03-11 20:52:55 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.693: INFO: Container no-snat-test ready: false, restart count 0 Mar 11 20:52:55.693: INFO: kube-multus-ds-amd64-gtmmz started at 2021-03-11 17:52:47 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.693: INFO: Container kube-multus ready: true, restart count 1 Mar 11 20:52:55.693: INFO: node-feature-discovery-worker-nf56t started at 2021-03-11 17:58:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.693: INFO: Container nfd-worker ready: true, restart count 0 Mar 11 20:52:55.693: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vf8xv started at 2021-03-11 18:00:01 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.693: INFO: Container kube-sriovdp ready: true, restart count 0 Mar 11 20:52:55.693: INFO: prometheus-k8s-0 started at 2021-03-11 18:04:37 +0000 UTC (0+5 container statuses recorded) Mar 11 20:52:55.693: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Mar 11 20:52:55.693: INFO: Container grafana ready: true, restart count 0 Mar 11 20:52:55.693: INFO: Container prometheus ready: true, restart count 1 Mar 11 20:52:55.693: INFO: Container prometheus-config-reloader ready: true, restart count 0 Mar 11 20:52:55.693: INFO: Container rules-configmap-reloader ready: true, restart count 0 Mar 11 20:52:55.693: INFO: node-exporter-mw629 started at 2021-03-11 18:04:28 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.693: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.693: INFO: Container node-exporter ready: true, restart count 0 Mar 11 20:52:55.693: INFO: iperf-e2e-pod-0 started at 2021-03-11 20:42:54 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.693: INFO: Container iperf-server ready: false, restart count 0 Mar 11 20:52:55.693: INFO: kube-proxy-5zz5g started at 2021-03-11 17:51:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.693: INFO: Container kube-proxy ready: true, restart count 2 Mar 11 20:52:55.693: INFO: kube-flannel-8pz9c started at 2021-03-11 17:52:37 +0000 UTC (1+1 container statuses recorded) Mar 11 20:52:55.693: INFO: Init container install-cni ready: true, restart count 0 Mar 11 20:52:55.693: INFO: Container kube-flannel ready: true, restart count 2 Mar 11 20:52:55.693: INFO: cmk-init-discover-node2-29mrv started at 2021-03-11 18:03:13 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.693: INFO: Container discover ready: false, restart count 0 Mar 11 20:52:55.693: INFO: Container init ready: false, restart count 0 Mar 11 20:52:55.693: INFO: Container install ready: false, restart count 0 Mar 11 20:52:55.693: INFO: cmk-webhook-888945845-2gpfq started at 2021-03-11 18:03:34 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.693: INFO: Container cmk-webhook ready: true, restart count 0 Mar 11 20:52:55.693: INFO: collectd-4rvsd started at 2021-03-11 18:07:58 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.693: INFO: Container collectd ready: true, restart count 0 Mar 11 20:52:55.693: INFO: Container collectd-exporter ready: true, restart count 0 Mar 11 20:52:55.693: INFO: Container rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.728: INFO: Latency metrics for node node1 Mar 11 20:52:55.728: INFO: Logging node info for node node2 Mar 11 20:52:55.730: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 48280382-daca-4d2c-a30b-cd693b7dd3e5 63283 0 2021-03-11 17:51:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.15.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.minor: kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"02:6c:14:b4:02:16"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major,system-os_release.VERSION_ID.minor nfd.node.kubernetes.io/worker.version:v0.5.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-03-11 17:51:58 +0000 UTC FieldsV1 FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 111 100 101 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 116 116 108 34 58 123 125 125 125 44 34 102 58 115 112 101 99 34 58 123 34 102 58 112 111 100 67 73 68 82 34 58 123 125 44 34 102 58 112 111 100 67 73 68 82 115 34 58 123 34 46 34 58 123 125 44 34 118 58 92 34 49 48 46 50 52 52 46 52 46 48 47 50 52 92 34 34 58 123 125 125 125 125],}} {kubeadm Update v1 2021-03-11 17:51:59 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 107 117 98 101 97 100 109 46 97 108 112 104 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 114 105 45 115 111 99 107 101 116 34 58 123 125 125 125 125],}} {flanneld Update v1 2021-03-11 17:54:35 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 100 97 116 97 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 98 97 99 107 101 110 100 45 116 121 112 101 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 107 117 98 101 45 115 117 98 110 101 116 45 109 97 110 97 103 101 114 34 58 123 125 44 34 102 58 102 108 97 110 110 101 108 46 97 108 112 104 97 46 99 111 114 101 111 115 46 99 111 109 47 112 117 98 108 105 99 45 105 112 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 78 101 116 119 111 114 107 85 110 97 118 97 105 108 97 98 108 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 125 125],}} {nfd-master Update v1 2021-03-11 17:59:05 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 102 58 110 102 100 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 102 101 97 116 117 114 101 45 108 97 98 101 108 115 34 58 123 125 44 34 102 58 110 102 100 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 119 111 114 107 101 114 46 118 101 114 115 105 111 110 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 68 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 69 83 78 73 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 50 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 66 87 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 67 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 68 81 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 70 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 65 86 88 53 49 50 86 76 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 70 77 65 51 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 72 76 69 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 73 66 80 66 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 77 80 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 82 84 77 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 83 84 73 66 80 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 99 112 117 105 100 46 86 77 88 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 104 97 114 100 119 97 114 101 95 109 117 108 116 105 116 104 114 101 97 100 105 110 103 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 112 115 116 97 116 101 46 116 117 114 98 111 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 67 77 84 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 76 51 67 65 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 66 65 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 66 77 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 112 117 45 114 100 116 46 82 68 84 77 79 78 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 99 111 110 102 105 103 46 78 79 95 72 90 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 99 111 110 102 105 103 46 78 79 95 72 90 95 70 85 76 76 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 115 101 108 105 110 117 120 46 101 110 97 98 108 101 100 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 102 117 108 108 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 109 97 106 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 109 105 110 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 107 101 114 110 101 108 45 118 101 114 115 105 111 110 46 114 101 118 105 115 105 111 110 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 109 101 109 111 114 121 45 110 117 109 97 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 110 101 116 119 111 114 107 45 115 114 105 111 118 46 99 97 112 97 98 108 101 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 110 101 116 119 111 114 107 45 115 114 105 111 118 46 99 111 110 102 105 103 117 114 101 100 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 112 99 105 45 48 51 48 48 95 49 97 48 51 46 112 114 101 115 101 110 116 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 116 111 114 97 103 101 45 110 111 110 114 111 116 97 116 105 111 110 97 108 100 105 115 107 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 73 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 46 109 97 106 111 114 34 58 123 125 44 34 102 58 102 101 97 116 117 114 101 46 110 111 100 101 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 115 121 115 116 101 109 45 111 115 95 114 101 108 101 97 115 101 46 86 69 82 83 73 79 78 95 73 68 46 109 105 110 111 114 34 58 123 125 125 125 125],}} {Swagger-Codegen Update v1 2021-03-11 18:01:45 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 108 97 98 101 108 115 34 58 123 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 99 109 107 45 110 111 100 101 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 101 120 99 108 117 115 105 118 101 45 99 111 114 101 115 34 58 123 125 125 125 125],}} {kubelet Update v1 2021-03-11 20:52:45 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 109 101 116 97 100 97 116 97 34 58 123 34 102 58 97 110 110 111 116 97 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 102 58 118 111 108 117 109 101 115 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 99 111 110 116 114 111 108 108 101 114 45 109 97 110 97 103 101 100 45 97 116 116 97 99 104 45 100 101 116 97 99 104 34 58 123 125 125 44 34 102 58 108 97 98 101 108 115 34 58 123 34 46 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 98 101 116 97 46 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 97 114 99 104 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 104 111 115 116 110 97 109 101 34 58 123 125 44 34 102 58 107 117 98 101 114 110 101 116 101 115 46 105 111 47 111 115 34 58 123 125 125 125 44 34 102 58 115 116 97 116 117 115 34 58 123 34 102 58 97 100 100 114 101 115 115 101 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 72 111 115 116 110 97 109 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 73 110 116 101 114 110 97 108 73 80 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 97 100 100 114 101 115 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 97 108 108 111 99 97 116 97 98 108 101 34 58 123 34 46 34 58 123 125 44 34 102 58 99 109 107 46 105 110 116 101 108 46 99 111 109 47 101 120 99 108 117 115 105 118 101 45 99 111 114 101 115 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 105 110 116 101 108 46 99 111 109 47 105 110 116 101 108 95 115 114 105 111 118 95 110 101 116 100 101 118 105 99 101 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 97 112 97 99 105 116 121 34 58 123 34 46 34 58 123 125 44 34 102 58 99 112 117 34 58 123 125 44 34 102 58 101 112 104 101 109 101 114 97 108 45 115 116 111 114 97 103 101 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 49 71 105 34 58 123 125 44 34 102 58 104 117 103 101 112 97 103 101 115 45 50 77 105 34 58 123 125 44 34 102 58 105 110 116 101 108 46 99 111 109 47 105 110 116 101 108 95 115 114 105 111 118 95 110 101 116 100 101 118 105 99 101 34 58 123 125 44 34 102 58 109 101 109 111 114 121 34 58 123 125 44 34 102 58 112 111 100 115 34 58 123 125 125 44 34 102 58 99 111 110 100 105 116 105 111 110 115 34 58 123 34 46 34 58 123 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 68 105 115 107 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 77 101 109 111 114 121 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 80 73 68 80 114 101 115 115 117 114 101 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 44 34 107 58 123 92 34 116 121 112 101 92 34 58 92 34 82 101 97 100 121 92 34 125 34 58 123 34 46 34 58 123 125 44 34 102 58 108 97 115 116 72 101 97 114 116 98 101 97 116 84 105 109 101 34 58 123 125 44 34 102 58 108 97 115 116 84 114 97 110 115 105 116 105 111 110 84 105 109 101 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 116 97 116 117 115 34 58 123 125 44 34 102 58 116 121 112 101 34 58 123 125 125 125 44 34 102 58 100 97 101 109 111 110 69 110 100 112 111 105 110 116 115 34 58 123 34 102 58 107 117 98 101 108 101 116 69 110 100 112 111 105 110 116 34 58 123 34 102 58 80 111 114 116 34 58 123 125 125 125 44 34 102 58 105 109 97 103 101 115 34 58 123 125 44 34 102 58 110 111 100 101 73 110 102 111 34 58 123 34 102 58 97 114 99 104 105 116 101 99 116 117 114 101 34 58 123 125 44 34 102 58 98 111 111 116 73 68 34 58 123 125 44 34 102 58 99 111 110 116 97 105 110 101 114 82 117 110 116 105 109 101 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 101 114 110 101 108 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 80 114 111 120 121 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 117 98 101 108 101 116 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 109 97 99 104 105 110 101 73 68 34 58 123 125 44 34 102 58 111 112 101 114 97 116 105 110 103 83 121 115 116 101 109 34 58 123 125 44 34 102 58 111 115 73 109 97 103 101 34 58 123 125 44 34 102 58 115 121 115 116 101 109 85 85 73 68 34 58 123 125 125 125 125],}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201259671552 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178911977472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-03-11 17:54:35 +0000 UTC,LastTransitionTime:2021-03-11 17:54:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:51:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-03-11 20:52:45 +0000 UTC,LastTransitionTime:2021-03-11 17:58:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:08627116483a4bf79f59d79a4a11d6f4,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:1be00882-edae-44a0-a65e-9f92c05d8856,KernelVersion:3.10.0-1160.15.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.12,KubeletVersion:v1.18.8,KubeProxyVersion:v1.18.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[opnfv/barometer-collectd@sha256:18abffcf9afb2c3cb0afac67de5f1317f7dcd8925906c434f4e18812d9efbb54],SizeBytes:1727353823,},ContainerImage{Names:[localhost:30500/cmk@sha256:fdd523af421b0b21e1d9a0699b629bc50687a7de7dcea78afe470b8eaeed4ae2 localhost:30500/cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726480407,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 k8s.gcr.io/etcd:3.4.3],SizeBytes:288426917,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:38cd3fe450dcded05650b49cd4c95b41fce97503892b5b760e9395d127bdf276 kubernetesui/dashboard-amd64:v2.0.2],SizeBytes:224634189,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:e9071531a6aa14fe50d882a68f10ee710d5203dd4bb07ff7a87d29cdc5a1fd5b k8s.gcr.io/kube-apiserver:v1.18.8],SizeBytes:173029757,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:8a2b2a8d3e586afdd223e096ab65db865d6dce680336f0b9f0d764b21abba06f k8s.gcr.io/kube-controller-manager:v1.18.8],SizeBytes:162425213,},ContainerImage{Names:[nginx@sha256:f3693fe50d5b1df1ecd315d54813a77afd56b0245a404055a946574deb6b34fc nginx:1.19],SizeBytes:133050457,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:6f6bd5c06680713d1047f7e27794c7c7d11e6859de5787dd4ca17d204669e683 k8s.gcr.io/kube-proxy:v1.18.8],SizeBytes:117264685,},ContainerImage{Names:[us.gcr.io/k8s-artifacts-prod/e2e-test-images/agnhost@sha256:1d7f0d77a6f07fd507f147a38d06a7c8269ebabd4f923bfe46d4fb8b396a520c us.gcr.io/k8s-artifacts-prod/e2e-test-images/agnhost:2.12],SizeBytes:111705925,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:ec7c376c780a3dd02d7e5850a0ca3d09fc8df50ac3ceb37a2214d403585361a0 k8s.gcr.io/kube-scheduler:v1.18.8],SizeBytes:95308157,},ContainerImage{Names:[quay.io/kubernetes_incubator/node-feature-discovery@sha256:99fe53b4555e717de68505ec46a10bc0e19c5e0d998fde5035bb623a65c75916 quay.io/kubernetes_incubator/node-feature-discovery:v0.5.0],SizeBytes:86455274,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:6d451d92c921f14bfb38196aacb6e506d4593c5b3c9d40a8b8a2506010dc3e10 quay.io/coreos/flannel:v0.12.0],SizeBytes:52767393,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[lachlanevenson/k8s-helm@sha256:dcf2036282694c6bfe2a533636dd8f494f63186b98e4118e741be04a9115af6a lachlanevenson/k8s-helm:v3.2.3],SizeBytes:46479395,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:0ebc8fa00465a6b16bda934a7e3c12e008aa2ed9d9e2ae31d3faca0ab94ada86 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44376083,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:a7f6555decef3c061cfb669be5137d2209690cafe459204126e01276f113b9af kubernetesui/metrics-scraper:v1.0.5],SizeBytes:36703493,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:0a63703fc308c6cb4207a707146ef234ff92011ee350289beec821e9a2c42765 localhost:30500/tas-controller:0.1],SizeBytes:23811271,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:96cd5db59860a84139d8d35c2e7662504a7c6cba7810831ed9374e0ddd9b1333 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/regression-issue-74839-amd64@sha256:3b36bd80b97c532a774e7f6246797b8575d97037982f353476c703ba6686c75c gcr.io/kubernetes-e2e-test-images/regression-issue-74839-amd64:1.0],SizeBytes:19227369,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 11 20:52:55.731: INFO: Logging kubelet events for node node2 Mar 11 20:52:55.734: INFO: Logging pods the kubelet thinks is on node node2 Mar 11 20:52:55.749: INFO: kube-flannel-8wwvj started at 2021-03-11 17:52:37 +0000 UTC (1+1 container statuses recorded) Mar 11 20:52:55.749: INFO: Init container install-cni ready: true, restart count 0 Mar 11 20:52:55.749: INFO: Container kube-flannel ready: true, restart count 2 Mar 11 20:52:55.749: INFO: node-exporter-x6vqx started at 2021-03-11 18:04:28 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.749: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.749: INFO: Container node-exporter ready: true, restart count 0 Mar 11 20:52:55.749: INFO: collectd-86ww6 started at 2021-03-11 18:07:58 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.749: INFO: Container collectd ready: true, restart count 0 Mar 11 20:52:55.749: INFO: Container collectd-exporter ready: true, restart count 0 Mar 11 20:52:55.749: INFO: Container rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.749: INFO: no-snat-test5tz7d started at 2021-03-11 20:52:55 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.749: INFO: Container no-snat-test ready: false, restart count 0 Mar 11 20:52:55.749: INFO: node-feature-discovery-worker-8xdg7 started at 2021-03-11 17:58:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.749: INFO: Container nfd-worker ready: true, restart count 0 Mar 11 20:52:55.749: INFO: kube-multus-ds-amd64-rpm89 started at 2021-03-11 17:52:47 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.749: INFO: Container kube-multus ready: true, restart count 1 Mar 11 20:52:55.749: INFO: prometheus-operator-f66f5fb4d-f2pkm started at 2021-03-11 18:04:21 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.749: INFO: Container kube-rbac-proxy ready: true, restart count 0 Mar 11 20:52:55.749: INFO: Container prometheus-operator ready: true, restart count 0 Mar 11 20:52:55.749: INFO: kube-proxy-znx8n started at 2021-03-11 17:51:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.749: INFO: Container kube-proxy ready: true, restart count 1 Mar 11 20:52:55.749: INFO: cmk-init-discover-node2-c5j6h started at 2021-03-11 18:02:02 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.749: INFO: Container discover ready: false, restart count 0 Mar 11 20:52:55.749: INFO: Container init ready: false, restart count 0 Mar 11 20:52:55.749: INFO: Container install ready: false, restart count 0 Mar 11 20:52:55.749: INFO: cmk-init-discover-node2-qbc6m started at 2021-03-11 18:02:53 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.749: INFO: Container discover ready: false, restart count 0 Mar 11 20:52:55.749: INFO: Container init ready: false, restart count 0 Mar 11 20:52:55.749: INFO: Container install ready: false, restart count 0 Mar 11 20:52:55.749: INFO: tas-telemetry-aware-scheduling-5ffb6fd745-wqfmz started at 2021-03-11 18:07:22 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.749: INFO: Container tas-controller ready: true, restart count 0 Mar 11 20:52:55.749: INFO: Container tas-extender ready: true, restart count 0 Mar 11 20:52:55.749: INFO: cmk-slzjv started at 2021-03-11 18:03:33 +0000 UTC (0+2 container statuses recorded) Mar 11 20:52:55.749: INFO: Container nodereport ready: true, restart count 0 Mar 11 20:52:55.749: INFO: Container reconcile ready: true, restart count 0 Mar 11 20:52:55.749: INFO: kubernetes-dashboard-57777fbdcb-zsnff started at 2021-03-11 17:53:12 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.749: INFO: Container kubernetes-dashboard ready: true, restart count 1 Mar 11 20:52:55.749: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-ptgh4 started at 2021-03-11 18:00:01 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.749: INFO: Container kube-sriovdp ready: true, restart count 0 Mar 11 20:52:55.749: INFO: cmk-init-discover-node2-9knwq started at 2021-03-11 18:02:23 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.749: INFO: Container discover ready: false, restart count 0 Mar 11 20:52:55.749: INFO: Container init ready: false, restart count 0 Mar 11 20:52:55.749: INFO: Container install ready: false, restart count 0 Mar 11 20:52:55.749: INFO: cmk-init-discover-node1-vk7wm started at 2021-03-11 18:01:40 +0000 UTC (0+3 container statuses recorded) Mar 11 20:52:55.749: INFO: Container discover ready: false, restart count 0 Mar 11 20:52:55.749: INFO: Container init ready: false, restart count 0 Mar 11 20:52:55.749: INFO: Container install ready: false, restart count 0 Mar 11 20:52:55.749: INFO: nginx-proxy-node2 started at 2021-03-11 17:51:59 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.749: INFO: Container nginx-proxy ready: true, restart count 2 Mar 11 20:52:55.749: INFO: kubernetes-metrics-scraper-54fbb4d595-dq4gp started at 2021-03-11 17:53:12 +0000 UTC (0+1 container statuses recorded) Mar 11 20:52:55.749: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 Mar 11 20:52:55.782: INFO: Latency metrics for node node2 Mar 11 20:52:55.782: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "no-snat-test-5551" for this suite.