/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:30:10.796: Container should have service environment variables set Unexpected error: <*errors.errorString | 0xc002f49210>: { s: "expected pod \"client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5\" success: Gave up after waiting 5m0s for pod \"client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5\" to be \"Succeeded or Failed\"", } expected pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" success: Gave up after waiting 5m0s for pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:527 [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:14:55.082: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should contain environment variables for services [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:14:59.137: INFO: Waiting up to 5m0s for pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" in namespace "pods-6918" to be "Succeeded or Failed" May 21 21:14:59.139: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.397332ms May 21 21:15:01.142: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005203203s May 21 21:15:03.146: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008702441s May 21 21:15:05.148: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.011103883s May 21 21:15:07.151: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.013902228s May 21 21:15:09.153: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.016656344s May 21 21:15:11.157: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.020462268s May 21 21:15:13.161: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.023998025s May 21 21:15:15.166: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.028790018s May 21 21:15:17.170: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.033403715s May 21 21:15:19.172: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.035576693s May 21 21:15:21.175: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.038431636s May 21 21:15:23.178: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 24.041621846s May 21 21:15:25.181: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 26.04402787s May 21 21:15:27.184: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 28.046748224s May 21 21:15:29.186: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.04949084s May 21 21:15:31.189: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.052242853s May 21 21:15:33.192: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 34.05514535s May 21 21:15:35.195: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 36.058047983s May 21 21:15:37.197: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 38.060359297s May 21 21:15:39.200: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 40.06330724s May 21 21:15:41.204: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 42.066741314s May 21 21:15:43.208: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 44.071037527s May 21 21:15:45.211: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 46.074275633s May 21 21:15:47.214: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 48.077568201s May 21 21:15:49.218: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 50.080854237s May 21 21:15:51.222: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 52.084889717s May 21 21:15:53.225: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 54.087729237s May 21 21:15:55.228: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 56.09118441s May 21 21:15:57.232: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 58.095093021s May 21 21:15:59.236: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.098822765s May 21 21:16:01.239: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.101814027s May 21 21:16:03.243: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.1057652s May 21 21:16:05.246: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.109534981s May 21 21:16:07.251: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.114598687s May 21 21:16:09.255: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.118431381s May 21 21:16:11.258: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.121487112s May 21 21:16:13.262: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.125339122s May 21 21:16:15.267: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.130287775s May 21 21:16:17.270: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.133179402s May 21 21:16:19.273: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.135993626s May 21 21:16:21.275: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.138655357s May 21 21:16:23.278: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.141102526s May 21 21:16:25.281: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.14463809s May 21 21:16:27.284: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.147566787s May 21 21:16:29.287: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.150530902s May 21 21:16:31.290: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.152819775s May 21 21:16:33.294: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.156759791s May 21 21:16:35.297: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.159937195s May 21 21:16:37.299: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.162314579s May 21 21:16:39.302: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.164805197s May 21 21:16:41.304: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.167601082s May 21 21:16:43.309: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.171913415s May 21 21:16:45.312: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.175320994s May 21 21:16:47.315: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.178564228s May 21 21:16:49.318: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.181068482s May 21 21:16:51.321: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.183918666s May 21 21:16:53.323: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.186625582s May 21 21:16:55.327: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.190416067s May 21 21:16:57.331: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.193910134s May 21 21:16:59.334: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.196772153s May 21 21:17:01.338: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.200989036s May 21 21:17:03.341: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.204420387s May 21 21:17:05.346: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.20874139s May 21 21:17:07.350: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.212851382s May 21 21:17:09.354: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.217018131s May 21 21:17:11.356: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.219599188s May 21 21:17:13.361: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.224155149s May 21 21:17:15.364: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.226893944s May 21 21:17:17.367: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.230416671s May 21 21:17:19.370: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.233192621s May 21 21:17:21.373: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.236298857s May 21 21:17:23.377: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.240575239s May 21 21:17:25.381: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.244099215s May 21 21:17:27.385: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.247796622s May 21 21:17:29.387: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.250530008s May 21 21:17:31.392: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.255640121s May 21 21:17:33.397: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.259845754s May 21 21:17:35.402: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.265556251s May 21 21:17:37.406: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.269172898s May 21 21:17:39.409: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.271855098s May 21 21:17:41.411: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.274474899s May 21 21:17:43.414: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.277342559s May 21 21:17:45.418: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.280863656s May 21 21:17:47.421: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.283786057s May 21 21:17:49.423: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.286502976s May 21 21:17:51.426: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.289097389s May 21 21:17:53.430: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.293088839s May 21 21:17:55.433: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.296042252s May 21 21:17:57.436: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.299617264s May 21 21:17:59.439: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.302521758s May 21 21:18:01.442: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.305056124s May 21 21:18:03.445: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.30852097s May 21 21:18:05.448: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.311564122s May 21 21:18:07.451: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.314549061s May 21 21:18:09.454: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.317594485s May 21 21:18:11.457: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.320047407s May 21 21:18:13.460: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.322940904s May 21 21:18:15.463: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.325915273s May 21 21:18:17.466: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.329567266s May 21 21:18:19.469: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.332506302s May 21 21:18:21.473: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.33605342s May 21 21:18:23.476: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.339099595s May 21 21:18:25.479: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.342387709s May 21 21:18:27.482: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.345575468s May 21 21:18:29.485: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.348618992s May 21 21:18:31.489: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.35230964s May 21 21:18:33.493: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.355698077s May 21 21:18:35.499: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.361865174s May 21 21:18:37.502: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.365048874s May 21 21:18:39.505: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.367886562s May 21 21:18:41.508: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.371492757s May 21 21:18:43.512: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.375511743s May 21 21:18:45.515: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.377915048s May 21 21:18:47.518: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.381042141s May 21 21:18:49.520: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.383453399s May 21 21:18:51.525: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.387707329s May 21 21:18:53.529: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.391734346s May 21 21:18:55.532: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.395606545s May 21 21:18:57.535: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.398665677s May 21 21:18:59.539: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.402026681s May 21 21:19:01.542: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.40518135s May 21 21:19:03.545: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.40865084s May 21 21:19:05.549: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.412243408s May 21 21:19:07.552: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.414861439s May 21 21:19:09.555: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.417747219s May 21 21:19:11.558: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.42118591s May 21 21:19:13.561: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.424445969s May 21 21:19:15.564: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.426853382s May 21 21:19:17.568: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.430964722s May 21 21:19:19.570: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.433620754s May 21 21:19:21.574: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.437264946s May 21 21:19:23.577: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.440375085s May 21 21:19:25.580: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.44359514s May 21 21:19:27.584: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.447355068s May 21 21:19:29.588: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.451407144s May 21 21:19:31.591: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.453953898s May 21 21:19:33.594: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.456953039s May 21 21:19:35.597: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.460002012s May 21 21:19:37.600: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.462827674s May 21 21:19:39.603: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.466034873s May 21 21:19:41.606: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.469444696s May 21 21:19:43.610: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.472919831s May 21 21:19:45.613: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.476136066s May 21 21:19:47.616: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.479468697s May 21 21:19:49.620: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.482985325s May 21 21:19:51.622: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.485458069s May 21 21:19:53.625: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.488012269s May 21 21:19:55.628: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.491356422s May 21 21:19:57.632: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.494951254s May 21 21:19:59.647: INFO: Failed to get logs from node "node1" pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" container "env3cont": the server rejected our request for an unknown reason (get pods client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5) STEP: delete the pod May 21 21:19:59.653: INFO: Waiting for pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to disappear May 21 21:19:59.655: INFO: Pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 still exists May 21 21:20:01.656: INFO: Waiting for pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to disappear May 21 21:20:01.660: INFO: Pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 still exists May 21 21:20:03.656: INFO: Waiting for pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to disappear May 21 21:20:03.659: INFO: Pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 no longer exists May 21 21:20:03.659: INFO: (Attempt 1 of 3) Unexpected error occurred: expected pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" success: Gave up after waiting 5m0s for pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" to be "Succeeded or Failed" May 21 21:20:03.671: INFO: Waiting up to 5m0s for pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" in namespace "pods-6918" to be "Succeeded or Failed" May 21 21:20:03.674: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.393234ms May 21 21:20:05.677: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005872903s May 21 21:20:07.681: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009296439s May 21 21:20:09.684: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.012599037s May 21 21:20:11.688: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.016023824s May 21 21:20:13.691: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.019114791s May 21 21:20:15.693: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.021635611s May 21 21:20:17.696: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.024293829s May 21 21:20:19.699: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.0279514s May 21 21:20:21.702: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.030720282s May 21 21:20:23.705: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.033471596s May 21 21:20:25.708: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.036750178s May 21 21:20:27.712: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 24.040627368s May 21 21:20:29.716: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 26.044490976s May 21 21:20:31.720: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 28.048585862s May 21 21:20:33.723: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.051856685s May 21 21:20:35.726: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.054530272s May 21 21:20:37.730: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 34.058248516s May 21 21:20:39.732: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 36.060950041s May 21 21:20:41.736: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 38.064416195s May 21 21:20:43.739: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 40.067941939s May 21 21:20:45.744: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 42.072245293s May 21 21:20:47.749: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 44.07702194s May 21 21:20:49.753: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 46.081297519s May 21 21:20:51.756: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 48.084075518s May 21 21:20:53.759: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 50.087060745s May 21 21:20:55.762: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 52.090304543s May 21 21:20:57.766: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 54.094025624s May 21 21:20:59.769: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 56.097489824s May 21 21:21:01.774: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 58.102093281s May 21 21:21:03.781: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.109965877s May 21 21:21:05.784: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.1127553s May 21 21:21:07.789: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.117021447s May 21 21:21:09.792: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.120411797s May 21 21:21:11.796: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.12479534s May 21 21:21:13.801: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.129267502s May 21 21:21:15.803: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.131963702s May 21 21:21:17.808: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.136200783s May 21 21:21:19.810: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.138953629s May 21 21:21:21.815: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.143128649s May 21 21:21:23.818: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.14687693s May 21 21:21:25.823: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.151427913s May 21 21:21:27.826: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.154621814s May 21 21:21:29.830: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.157985336s May 21 21:21:31.833: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.161870184s May 21 21:21:33.839: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.167009145s May 21 21:21:35.842: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.170142119s May 21 21:21:37.845: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.173822056s May 21 21:21:39.848: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.176493266s May 21 21:21:41.853: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.181786854s May 21 21:21:43.858: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.186463675s May 21 21:21:45.861: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.189424474s May 21 21:21:47.866: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.194157004s May 21 21:21:49.869: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.197290932s May 21 21:21:51.873: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.201878537s May 21 21:21:53.878: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.206068047s May 21 21:21:55.880: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.208898515s May 21 21:21:57.885: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.213227541s May 21 21:21:59.888: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.2166258s May 21 21:22:01.893: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.22114504s May 21 21:22:03.896: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.224549003s May 21 21:22:05.899: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.22767411s May 21 21:22:07.902: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.230657782s May 21 21:22:09.907: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.235294634s May 21 21:22:11.910: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.238625858s May 21 21:22:13.913: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.241729926s May 21 21:22:15.918: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.24599257s May 21 21:22:17.920: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.248731548s May 21 21:22:19.924: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.25285868s May 21 21:22:21.928: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.256291095s May 21 21:22:23.930: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.25888182s May 21 21:22:25.934: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.26272905s May 21 21:22:27.937: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.265447587s May 21 21:22:29.941: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.269578161s May 21 21:22:31.944: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.272384998s May 21 21:22:33.948: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.276196496s May 21 21:22:35.951: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.279304099s May 21 21:22:37.954: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.282608331s May 21 21:22:39.957: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.28539777s May 21 21:22:41.962: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.290353272s May 21 21:22:43.968: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.296397386s May 21 21:22:45.972: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.300299985s May 21 21:22:47.975: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.303825288s May 21 21:22:49.979: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.307232661s May 21 21:22:51.982: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.310788949s May 21 21:22:53.985: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.313830588s May 21 21:22:55.989: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.317867419s May 21 21:22:57.992: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.320508311s May 21 21:22:59.997: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.325343374s May 21 21:23:02.000: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.328768707s May 21 21:23:04.005: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.333218442s May 21 21:23:06.009: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.337055833s May 21 21:23:08.011: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.3399746s May 21 21:23:10.014: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.342389166s May 21 21:23:12.017: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.345877034s May 21 21:23:14.021: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.348991073s May 21 21:23:16.023: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.351883004s May 21 21:23:18.027: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.355356848s May 21 21:23:20.030: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.358057696s May 21 21:23:22.033: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.361740569s May 21 21:23:24.037: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.365066009s May 21 21:23:26.039: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.367927441s May 21 21:23:28.042: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.370868349s May 21 21:23:30.045: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.373031755s May 21 21:23:32.047: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.375709046s May 21 21:23:34.051: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.379900013s May 21 21:23:36.055: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.383855352s May 21 21:23:38.058: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.386691448s May 21 21:23:40.061: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.389231694s May 21 21:23:42.065: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.393199493s May 21 21:23:44.069: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.397924058s May 21 21:23:46.073: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.401640663s May 21 21:23:48.076: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.404549903s May 21 21:23:50.079: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.407571649s May 21 21:23:52.082: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.41026566s May 21 21:23:54.084: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.412723812s May 21 21:23:56.088: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.41625612s May 21 21:23:58.090: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.418778136s May 21 21:24:00.094: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.422058134s May 21 21:24:02.096: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.424739728s May 21 21:24:04.100: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.428036476s May 21 21:24:06.102: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.430751065s May 21 21:24:08.105: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.433475529s May 21 21:24:10.108: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.43643055s May 21 21:24:12.112: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.440131159s May 21 21:24:14.114: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.442964718s May 21 21:24:16.118: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.446601035s May 21 21:24:18.121: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.449364035s May 21 21:24:20.124: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.452228049s May 21 21:24:22.127: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.455543663s May 21 21:24:24.131: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.459157501s May 21 21:24:26.133: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.461926881s May 21 21:24:28.137: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.465187115s May 21 21:24:30.140: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.468183261s May 21 21:24:32.143: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.471928601s May 21 21:24:34.147: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.475862327s May 21 21:24:36.150: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.478351859s May 21 21:24:38.153: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.481813352s May 21 21:24:40.156: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.484164871s May 21 21:24:42.159: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.487155293s May 21 21:24:44.162: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.490035556s May 21 21:24:46.164: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.492950812s May 21 21:24:48.167: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.495972633s May 21 21:24:50.171: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.499055151s May 21 21:24:52.174: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.502482054s May 21 21:24:54.177: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.505283156s May 21 21:24:56.179: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.507480674s May 21 21:24:58.183: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.511467533s May 21 21:25:00.189: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.517200484s May 21 21:25:02.193: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.521698986s May 21 21:25:04.203: INFO: Failed to get logs from node "node2" pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" container "env3cont": the server rejected our request for an unknown reason (get pods client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5) STEP: delete the pod May 21 21:25:04.207: INFO: Waiting for pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to disappear May 21 21:25:04.210: INFO: Pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 still exists May 21 21:25:06.211: INFO: Waiting for pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to disappear May 21 21:25:06.213: INFO: Pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 no longer exists May 21 21:25:06.213: INFO: (Attempt 2 of 3) Unexpected error occurred: expected pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" success: Gave up after waiting 5m0s for pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" to be "Succeeded or Failed" May 21 21:25:06.225: INFO: Waiting up to 5m0s for pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" in namespace "pods-6918" to be "Succeeded or Failed" May 21 21:25:06.227: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1.777668ms May 21 21:25:08.231: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005849612s May 21 21:25:10.235: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009582642s May 21 21:25:12.238: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.012416438s May 21 21:25:14.240: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.014930225s May 21 21:25:16.244: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.018297083s May 21 21:25:18.249: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.023147059s May 21 21:25:20.251: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.0257919s May 21 21:25:22.254: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.029116258s May 21 21:25:24.257: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.031747903s May 21 21:25:26.261: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.035150602s May 21 21:25:28.265: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.039794044s May 21 21:25:30.270: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 24.044445891s May 21 21:25:32.275: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 26.04945074s May 21 21:25:34.279: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 28.053150856s May 21 21:25:36.284: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.058540303s May 21 21:25:38.289: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.063823628s May 21 21:25:40.292: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 34.066799724s May 21 21:25:42.297: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 36.071189231s May 21 21:25:44.301: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 38.07513712s May 21 21:25:46.304: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 40.078733997s May 21 21:25:48.309: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 42.083488464s May 21 21:25:50.313: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 44.087313273s May 21 21:25:52.315: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 46.089845262s May 21 21:25:54.319: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 48.093341743s May 21 21:25:56.322: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 50.096907614s May 21 21:25:58.327: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 52.101470838s May 21 21:26:00.330: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 54.104798271s May 21 21:26:02.335: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 56.109147195s May 21 21:26:04.338: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 58.112328702s May 21 21:26:06.341: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.115560248s May 21 21:26:08.344: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.11830257s May 21 21:26:10.348: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.122446707s May 21 21:26:12.352: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.126726084s May 21 21:26:14.356: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.130592802s May 21 21:26:16.360: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.134475304s May 21 21:26:18.363: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.137776701s May 21 21:26:20.366: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.140580348s May 21 21:26:22.370: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.144323737s May 21 21:26:24.372: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.146998189s May 21 21:26:26.376: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.150539055s May 21 21:26:28.379: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.154125894s May 21 21:26:30.383: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.158052708s May 21 21:26:32.387: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.161825365s May 21 21:26:34.391: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.165884575s May 21 21:26:36.394: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.168517586s May 21 21:26:38.396: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.171084297s May 21 21:26:40.399: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.174115453s May 21 21:26:42.402: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.176971938s May 21 21:26:44.407: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.181210485s May 21 21:26:46.410: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.185061266s May 21 21:26:48.414: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.188487156s May 21 21:26:50.417: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.191652022s May 21 21:26:52.420: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.194750809s May 21 21:26:54.423: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.197639737s May 21 21:26:56.426: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.200589764s May 21 21:26:58.429: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.204021718s May 21 21:27:00.432: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.206845188s May 21 21:27:02.436: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.21044681s May 21 21:27:04.438: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.212765063s May 21 21:27:06.441: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.215563459s May 21 21:27:08.444: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.218790999s May 21 21:27:10.448: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.22241606s May 21 21:27:12.451: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.225852267s May 21 21:27:14.454: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.228855954s May 21 21:27:16.457: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.232118419s May 21 21:27:18.462: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.236185722s May 21 21:27:20.466: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.240375727s May 21 21:27:22.470: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.244819758s May 21 21:27:24.472: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.246956765s May 21 21:27:26.476: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.250419406s May 21 21:27:28.480: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.254590084s May 21 21:27:30.484: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.258295683s May 21 21:27:32.486: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.261026028s May 21 21:27:34.489: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.264055044s May 21 21:27:36.494: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.26857237s May 21 21:27:38.498: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.272867971s May 21 21:27:40.503: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.277402839s May 21 21:27:42.506: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.280299747s May 21 21:27:44.509: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.283272384s May 21 21:27:46.512: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.286352791s May 21 21:27:48.515: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.289647837s May 21 21:27:50.519: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.294024431s May 21 21:27:52.522: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.297027797s May 21 21:27:54.526: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.300804677s May 21 21:27:56.529: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.303994524s May 21 21:27:58.533: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.308005452s May 21 21:28:00.537: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.31148685s May 21 21:28:02.540: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.314229094s May 21 21:28:04.542: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.316827687s May 21 21:28:06.545: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.319710509s May 21 21:28:08.548: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.32282313s May 21 21:28:10.551: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.325769844s May 21 21:28:12.555: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.330006268s May 21 21:28:14.560: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.334304201s May 21 21:28:16.562: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.337008787s May 21 21:28:18.566: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.340236407s May 21 21:28:20.570: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.344291888s May 21 21:28:22.574: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.348569476s May 21 21:28:24.577: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.351335655s May 21 21:28:26.581: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.355303339s May 21 21:28:28.583: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.358005868s May 21 21:28:30.587: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.361746711s May 21 21:28:32.591: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.365339882s May 21 21:28:34.595: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.369241858s May 21 21:28:36.597: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.371875013s May 21 21:28:38.600: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.374436777s May 21 21:28:40.604: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.378389508s May 21 21:28:42.607: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.382065455s May 21 21:28:44.611: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.385610175s May 21 21:28:46.615: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.389565408s May 21 21:28:48.618: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.392711699s May 21 21:28:50.621: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.395609841s May 21 21:28:52.624: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.398491349s May 21 21:28:54.627: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.401338669s May 21 21:28:56.630: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.404693452s May 21 21:28:58.635: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.40959895s May 21 21:29:00.638: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.412795053s May 21 21:29:02.642: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.416930005s May 21 21:29:04.647: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.421422336s May 21 21:29:06.650: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.424596033s May 21 21:29:08.655: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.429390502s May 21 21:29:10.658: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.432560422s May 21 21:29:12.663: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.437550652s May 21 21:29:14.668: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.44225675s May 21 21:29:16.671: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.445602559s May 21 21:29:18.678: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.45223141s May 21 21:29:20.681: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.455486029s May 21 21:29:22.686: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.460533408s May 21 21:29:24.689: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.46409474s May 21 21:29:26.695: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.469577147s May 21 21:29:28.702: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.476834752s May 21 21:29:30.706: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.480175124s May 21 21:29:32.710: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.484901211s May 21 21:29:34.714: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.489079249s May 21 21:29:36.718: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.492999457s May 21 21:29:38.723: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.497803501s May 21 21:29:40.726: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.501103761s May 21 21:29:42.730: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.505105074s May 21 21:29:44.734: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.508387072s May 21 21:29:46.739: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.513565473s May 21 21:29:48.743: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.517908349s May 21 21:29:50.747: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.521162011s May 21 21:29:52.749: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.52378262s May 21 21:29:54.753: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.527606156s May 21 21:29:56.757: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.531533492s May 21 21:29:58.761: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.536020105s May 21 21:30:00.765: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.539257048s May 21 21:30:02.769: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.543621892s May 21 21:30:04.774: INFO: Pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.548204429s May 21 21:30:06.784: INFO: Failed to get logs from node "node2" pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" container "env3cont": the server rejected our request for an unknown reason (get pods client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5) STEP: delete the pod May 21 21:30:06.789: INFO: Waiting for pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to disappear May 21 21:30:06.791: INFO: Pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 still exists May 21 21:30:08.792: INFO: Waiting for pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to disappear May 21 21:30:08.794: INFO: Pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 still exists May 21 21:30:10.791: INFO: Waiting for pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to disappear May 21 21:30:10.795: INFO: Pod client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 no longer exists May 21 21:30:10.795: INFO: (Attempt 3 of 3) Unexpected error occurred: expected pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" success: Gave up after waiting 5m0s for pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" to be "Succeeded or Failed" goroutine 96 [running]: runtime/debug.Stack(0x4, 0x4be5f6e, 0x2) /usr/local/go/src/runtime/debug/stack.go:24 +0x9f runtime/debug.PrintStack() /usr/local/go/src/runtime/debug/stack.go:16 +0x25 k8s.io/kubernetes/test/e2e/common.expectNoErrorWithRetries(0xc00127d108, 0x3, 0xc003f9b600, 0x1, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:173 +0x2bc k8s.io/kubernetes/test/e2e/common.glob..func18.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:527 +0xaf2 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc00124a960, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113 +0xa3 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).run(0xc00124a960, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:64 +0x15c k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*ItNode).Run(0xc00124c880, 0x52e17e0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/it_node.go:26 +0x87 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).runSample(0xc002d1c870, 0x0, 0x52e17e0, 0xc000160900) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:215 +0x72f k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).Run(0xc002d1c870, 0x52e17e0, 0xc000160900) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:138 +0xf2 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpec(0xc003ea2000, 0xc002d1c870, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:200 +0x111 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpecs(0xc003ea2000, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:170 +0x127 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run(0xc003ea2000, 0xc0042020e0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:66 +0x117 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/suite.(*Suite).Run(0xc00016c280, 0x7f6117c65628, 0xc00190b200, 0x4c22012, 0x14, 0xc003073b90, 0x3, 0x3, 0x5396840, 0xc000160900, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/suite/suite.go:62 +0x426 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo.RunSpecsWithCustomReporters(0x52e6440, 0xc00190b200, 0x4c22012, 0x14, 0xc003612f80, 0x3, 0x4, 0x4) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:226 +0x238 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo.RunSpecsWithDefaultAndCustomReporters(0x52e6440, 0xc00190b200, 0x4c22012, 0x14, 0xc002920700, 0x2, 0x2, 0x2) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:214 +0xad k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00190b200, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 May 21 21:30:10.796: FAIL: Container should have service environment variables set Unexpected error: <*errors.errorString | 0xc002f49210>: { s: "expected pod \"client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5\" success: Gave up after waiting 5m0s for pod \"client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5\" to be \"Succeeded or Failed\"", } expected pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" success: Gave up after waiting 5m0s for pod "client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func18.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:527 +0xaf2 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00190b200, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-6918". STEP: Found 29 events. May 21 21:30:10.801: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: { } Scheduled: Successfully assigned pods-6918/client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to node2 May 21 21:30:10.801: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: { } Scheduled: Successfully assigned pods-6918/client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to node2 May 21 21:30:10.801: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: { } Scheduled: Successfully assigned pods-6918/client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 to node1 May 21 21:30:10.801: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807: { } Scheduled: Successfully assigned pods-6918/server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807 to node1 May 21 21:30:10.801: INFO: At 2021-05-21 21:14:57 +0000 UTC - event for server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807: {multus } AddedInterface: Add eth0 [10.244.3.43/24] May 21 21:30:10.801: INFO: At 2021-05-21 21:14:57 +0000 UTC - event for server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 468.049414ms May 21 21:30:10.801: INFO: At 2021-05-21 21:14:57 +0000 UTC - event for server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 21 21:30:10.801: INFO: At 2021-05-21 21:14:58 +0000 UTC - event for server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807: {kubelet node1} Created: Created container srv May 21 21:30:10.801: INFO: At 2021-05-21 21:14:58 +0000 UTC - event for server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807: {kubelet node1} Started: Started container srv May 21 21:30:10.801: INFO: At 2021-05-21 21:15:00 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:30:10.801: INFO: At 2021-05-21 21:15:00 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {multus } AddedInterface: Add eth0 [10.244.3.45/24] May 21 21:30:10.801: INFO: At 2021-05-21 21:15:01 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node1} Failed: Error: ErrImagePull May 21 21:30:10.801: INFO: At 2021-05-21 21:15:01 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:30:10.801: INFO: At 2021-05-21 21:15:02 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:30:10.801: INFO: At 2021-05-21 21:15:02 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node1} Failed: Error: ImagePullBackOff May 21 21:30:10.801: INFO: At 2021-05-21 21:20:05 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {multus } AddedInterface: Add eth0 [10.244.4.109/24] May 21 21:30:10.801: INFO: At 2021-05-21 21:20:05 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:30:10.801: INFO: At 2021-05-21 21:20:06 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} Failed: Error: ErrImagePull May 21 21:30:10.801: INFO: At 2021-05-21 21:20:06 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:30:10.801: INFO: At 2021-05-21 21:20:07 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:30:10.801: INFO: At 2021-05-21 21:20:07 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:30:10.801: INFO: At 2021-05-21 21:25:08 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {multus } AddedInterface: Add eth0 [10.244.4.129/24] May 21 21:30:10.801: INFO: At 2021-05-21 21:25:08 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:30:10.801: INFO: At 2021-05-21 21:25:09 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} Failed: Error: ErrImagePull May 21 21:30:10.801: INFO: At 2021-05-21 21:25:09 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:30:10.801: INFO: At 2021-05-21 21:25:10 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 21 21:30:10.801: INFO: At 2021-05-21 21:25:12 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:30:10.801: INFO: At 2021-05-21 21:25:12 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {multus } AddedInterface: Add eth0 [10.244.4.130/24] May 21 21:30:10.801: INFO: At 2021-05-21 21:25:12 +0000 UTC - event for client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:30:10.804: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:30:10.804: INFO: server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807 node1 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:14:55 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:14:59 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:14:59 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:14:55 +0000 UTC }] May 21 21:30:10.804: INFO: May 21 21:30:10.807: INFO: Logging node info for node master1 May 21 21:30:10.809: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 29984 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:30:10.810: INFO: Logging kubelet events for node master1 May 21 21:30:10.812: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:30:10.833: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.833: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:30:10.833: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:30:10.833: INFO: Init container install-cni ready: true, restart count 0 May 21 21:30:10.833: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:30:10.833: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.833: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:30:10.833: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.833: INFO: Container kube-multus ready: true, restart count 1 May 21 21:30:10.833: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:30:10.833: INFO: Container docker-registry ready: true, restart count 0 May 21 21:30:10.833: INFO: Container nginx ready: true, restart count 0 May 21 21:30:10.833: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.833: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:30:10.833: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:30:10.833: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:10.833: INFO: Container node-exporter ready: true, restart count 0 May 21 21:30:10.833: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.833: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:30:10.833: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.833: INFO: Container kube-apiserver ready: true, restart count 0 W0521 21:30:10.848338 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:30:10.876: INFO: Latency metrics for node master1 May 21 21:30:10.876: INFO: Logging node info for node master2 May 21 21:30:10.879: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 30051 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:07 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:07 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:07 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:30:07 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:30:10.880: INFO: Logging kubelet events for node master2 May 21 21:30:10.882: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:30:10.890: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:30:10.890: INFO: Init container install-cni ready: true, restart count 0 May 21 21:30:10.890: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:30:10.890: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.890: INFO: Container kube-multus ready: true, restart count 1 May 21 21:30:10.890: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.890: INFO: Container autoscaler ready: true, restart count 2 May 21 21:30:10.890: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:30:10.890: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:10.890: INFO: Container node-exporter ready: true, restart count 0 May 21 21:30:10.890: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.890: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:30:10.890: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.890: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:30:10.890: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.890: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:30:10.890: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.890: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:30:10.890: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.890: INFO: Container coredns ready: true, restart count 1 W0521 21:30:10.901468 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:30:10.931: INFO: Latency metrics for node master2 May 21 21:30:10.931: INFO: Logging node info for node master3 May 21 21:30:10.933: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 29989 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:30:10.934: INFO: Logging kubelet events for node master3 May 21 21:30:10.937: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:30:10.945: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.945: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:30:10.945: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.945: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:30:10.945: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:30:10.945: INFO: Init container install-cni ready: true, restart count 0 May 21 21:30:10.945: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:30:10.945: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.945: INFO: Container kube-multus ready: true, restart count 1 May 21 21:30:10.945: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.945: INFO: Container coredns ready: true, restart count 1 May 21 21:30:10.945: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:30:10.945: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:10.945: INFO: Container node-exporter ready: true, restart count 0 May 21 21:30:10.945: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.945: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:30:10.945: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:30:10.945: INFO: Container kube-scheduler ready: true, restart count 1 W0521 21:30:10.958536 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:30:10.988: INFO: Latency metrics for node master3 May 21 21:30:10.988: INFO: Logging node info for node node1 May 21 21:30:10.991: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 30041 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:06 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:06 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:06 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:30:06 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:30:10.992: INFO: Logging kubelet events for node node1 May 21 21:30:10.994: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:30:11.010: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:30:11.010: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:30:11.010: INFO: Container discover ready: false, restart count 0 May 21 21:30:11.010: INFO: Container init ready: false, restart count 0 May 21 21:30:11.010: INFO: Container install ready: false, restart count 0 May 21 21:30:11.010: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:30:11.010: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:30:11.010: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:30:11.010: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:11.010: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:30:11.010: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:30:11.010: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:11.010: INFO: Container node-exporter ready: true, restart count 0 May 21 21:30:11.010: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container kube-multus ready: true, restart count 1 May 21 21:30:11.010: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:30:11.010: INFO: var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587 started at 2021-05-21 21:26:13 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container dapi-container ready: false, restart count 0 May 21 21:30:11.010: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:30:11.010: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:30:11.010: INFO: Container grafana ready: true, restart count 0 May 21 21:30:11.010: INFO: Container prometheus ready: true, restart count 1 May 21 21:30:11.010: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:30:11.010: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:30:11.010: INFO: pod-configmaps-46c95fa0-506c-4e37-a8fc-a5f6c01a1c72 started at 2021-05-21 21:26:05 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container env-test ready: false, restart count 0 May 21 21:30:11.010: INFO: labelsupdatef591f359-8834-48e2-b911-31b34e549aef started at 2021-05-21 21:30:05 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container client-container ready: true, restart count 0 May 21 21:30:11.010: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:30:11.010: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:30:11.010: INFO: Container nodereport ready: true, restart count 0 May 21 21:30:11.010: INFO: Container reconcile ready: true, restart count 0 May 21 21:30:11.010: INFO: test-pod started at 2021-05-21 21:28:21 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container webserver ready: false, restart count 0 May 21 21:30:11.010: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:30:11.010: INFO: Init container install-cni ready: true, restart count 1 May 21 21:30:11.010: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:30:11.010: INFO: server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807 started at 2021-05-21 21:14:55 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container srv ready: true, restart count 0 May 21 21:30:11.010: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:30:11.010: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:30:11.010: INFO: Container collectd ready: true, restart count 0 May 21 21:30:11.010: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:30:11.010: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:30:11.010: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.010: INFO: Container kube-sriovdp ready: true, restart count 0 W0521 21:30:11.021919 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:30:11.052: INFO: Latency metrics for node node1 May 21 21:30:11.052: INFO: Logging node info for node node2 May 21 21:30:11.055: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 30052 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:08 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:08 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:08 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:30:08 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:30:11.056: INFO: Logging kubelet events for node node2 May 21 21:30:11.058: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:30:11.069: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.069: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:30:11.069: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.069: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:30:11.069: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:30:11.069: INFO: Container nodereport ready: true, restart count 0 May 21 21:30:11.069: INFO: Container reconcile ready: true, restart count 0 May 21 21:30:11.069: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:30:11.069: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:11.069: INFO: Container node-exporter ready: true, restart count 0 May 21 21:30:11.069: INFO: ss-0 started at 2021-05-21 21:24:41 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.069: INFO: Container webserver ready: false, restart count 0 May 21 21:30:11.069: INFO: test-rolling-update-controller-5gmll started at 2021-05-21 21:25:06 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.069: INFO: Container httpd ready: false, restart count 0 May 21 21:30:11.069: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:30:11.069: INFO: Init container install-cni ready: true, restart count 2 May 21 21:30:11.069: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:30:11.069: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.069: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:30:11.069: INFO: downward-api-693016f4-b946-499b-94de-e704d3cf4782 started at 2021-05-21 21:25:19 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.069: INFO: Container dapi-container ready: false, restart count 0 May 21 21:30:11.069: INFO: ss-0 started at 2021-05-21 21:25:26 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.069: INFO: Container webserver ready: false, restart count 0 May 21 21:30:11.069: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.069: INFO: Container kube-multus ready: true, restart count 1 May 21 21:30:11.069: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:30:11.069: INFO: Container discover ready: false, restart count 0 May 21 21:30:11.069: INFO: Container init ready: false, restart count 0 May 21 21:30:11.069: INFO: Container install ready: false, restart count 0 May 21 21:30:11.069: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:30:11.069: INFO: Container tas-controller ready: true, restart count 0 May 21 21:30:11.070: INFO: Container tas-extender ready: true, restart count 0 May 21 21:30:11.070: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:11.070: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:30:11.070: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:30:11.070: INFO: Container collectd ready: true, restart count 0 May 21 21:30:11.070: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:30:11.070: INFO: Container rbac-proxy ready: true, restart count 0 W0521 21:30:11.081916 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:30:11.120: INFO: Latency metrics for node node2 May 21 21:30:11.120: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-6918" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:35:11.211: starting pod busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab in namespace container-probe-1911 Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:426 [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:30:11.169: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-probe STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:54 [It] should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab in namespace container-probe-1911 May 21 21:35:11.211: FAIL: starting pod busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab in namespace container-probe-1911 Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc0003a91e0, 0xc000180800, 0x0, 0x37e11d6000) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:426 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.5() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:146 +0x197 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00190b200, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 STEP: deleting the pod [AfterEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "container-probe-1911". STEP: Found 7 events. May 21 21:35:11.225: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab: { } Scheduled: Successfully assigned container-probe-1911/busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab to node2 May 21 21:35:11.225: INFO: At 2021-05-21 21:30:12 +0000 UTC - event for busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab: {multus } AddedInterface: Add eth0 [10.244.4.149/24] May 21 21:35:11.225: INFO: At 2021-05-21 21:30:12 +0000 UTC - event for busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:35:11.225: INFO: At 2021-05-21 21:30:13 +0000 UTC - event for busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:35:11.225: INFO: At 2021-05-21 21:30:13 +0000 UTC - event for busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab: {kubelet node2} Failed: Error: ErrImagePull May 21 21:35:11.225: INFO: At 2021-05-21 21:30:14 +0000 UTC - event for busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:35:11.225: INFO: At 2021-05-21 21:30:14 +0000 UTC - event for busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:35:11.227: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:35:11.227: INFO: May 21 21:35:11.231: INFO: Logging node info for node master1 May 21 21:35:11.233: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 32827 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:05 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:05 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:05 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:35:05 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:35:11.234: INFO: Logging kubelet events for node master1 May 21 21:35:11.236: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:35:11.245: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.245: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:35:11.245: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:35:11.245: INFO: Init container install-cni ready: true, restart count 0 May 21 21:35:11.245: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:35:11.245: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.245: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:35:11.245: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.245: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:35:11.245: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.245: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:35:11.245: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.245: INFO: Container kube-multus ready: true, restart count 1 May 21 21:35:11.245: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.245: INFO: Container docker-registry ready: true, restart count 0 May 21 21:35:11.245: INFO: Container nginx ready: true, restart count 0 May 21 21:35:11.245: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.245: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:35:11.245: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.245: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:11.245: INFO: Container node-exporter ready: true, restart count 0 W0521 21:35:11.257993 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:35:11.287: INFO: Latency metrics for node master1 May 21 21:35:11.287: INFO: Logging node info for node master2 May 21 21:35:11.290: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 32857 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:08 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:08 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:08 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:35:08 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:35:11.290: INFO: Logging kubelet events for node master2 May 21 21:35:11.293: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:35:11.302: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.302: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:11.302: INFO: Container node-exporter ready: true, restart count 0 May 21 21:35:11.302: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.302: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:35:11.302: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.302: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:35:11.302: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.302: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:35:11.302: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:35:11.302: INFO: Init container install-cni ready: true, restart count 0 May 21 21:35:11.302: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:35:11.302: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.302: INFO: Container kube-multus ready: true, restart count 1 May 21 21:35:11.302: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.302: INFO: Container autoscaler ready: true, restart count 2 May 21 21:35:11.302: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.302: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:35:11.302: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.302: INFO: Container coredns ready: true, restart count 1 W0521 21:35:11.314744 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:35:11.343: INFO: Latency metrics for node master2 May 21 21:35:11.343: INFO: Logging node info for node master3 May 21 21:35:11.346: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 32826 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:05 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:05 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:05 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:35:05 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:35:11.346: INFO: Logging kubelet events for node master3 May 21 21:35:11.348: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:35:11.355: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.356: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:35:11.356: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.356: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:35:11.356: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.356: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:35:11.356: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.356: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:35:11.356: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:35:11.356: INFO: Init container install-cni ready: true, restart count 0 May 21 21:35:11.356: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:35:11.356: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.356: INFO: Container kube-multus ready: true, restart count 1 May 21 21:35:11.356: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.356: INFO: Container coredns ready: true, restart count 1 May 21 21:35:11.356: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.356: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:11.356: INFO: Container node-exporter ready: true, restart count 0 W0521 21:35:11.367919 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:35:11.395: INFO: Latency metrics for node master3 May 21 21:35:11.395: INFO: Logging node info for node node1 May 21 21:35:11.397: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 32868 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:09 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:09 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:09 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:35:09 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:35:11.398: INFO: Logging kubelet events for node node1 May 21 21:35:11.400: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:35:11.417: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.417: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:35:11.417: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.417: INFO: Container nodereport ready: true, restart count 0 May 21 21:35:11.417: INFO: Container reconcile ready: true, restart count 0 May 21 21:35:11.417: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:35:11.417: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:35:11.417: INFO: Container grafana ready: true, restart count 0 May 21 21:35:11.417: INFO: Container prometheus ready: true, restart count 1 May 21 21:35:11.417: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:35:11.417: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:35:11.417: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:35:11.417: INFO: Init container install-cni ready: true, restart count 1 May 21 21:35:11.417: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:35:11.417: INFO: liveness-a5f9f699-4122-4365-aff2-0c97e279f909 started at 2021-05-21 21:35:08 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.417: INFO: Container liveness ready: false, restart count 0 May 21 21:35:11.417: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.417: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:35:11.417: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:35:11.417: INFO: Container collectd ready: true, restart count 0 May 21 21:35:11.417: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:35:11.417: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:35:11.417: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.417: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:35:11.417: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.417: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:35:11.417: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:35:11.417: INFO: Container discover ready: false, restart count 0 May 21 21:35:11.417: INFO: Container init ready: false, restart count 0 May 21 21:35:11.417: INFO: Container install ready: false, restart count 0 May 21 21:35:11.417: INFO: pod-configmaps-973853b2-2b0a-427a-b65f-a3b4fe6dfc9c started at 2021-05-21 21:31:56 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.417: INFO: Container configmap-volume-binary-test ready: false, restart count 0 May 21 21:35:11.417: INFO: Container configmap-volume-data-test ready: true, restart count 0 May 21 21:35:11.417: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.417: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:35:11.417: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.417: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:35:11.417: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.417: INFO: Container kube-multus ready: true, restart count 1 May 21 21:35:11.417: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.417: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:35:11.417: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.417: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:11.417: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:35:11.417: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.417: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:11.417: INFO: Container node-exporter ready: true, restart count 0 W0521 21:35:11.432715 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:35:11.482: INFO: Latency metrics for node node1 May 21 21:35:11.482: INFO: Logging node info for node node2 May 21 21:35:11.485: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 32866 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:09 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:09 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:09 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:35:09 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:35:11.486: INFO: Logging kubelet events for node node2 May 21 21:35:11.488: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:35:11.503: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container kube-multus ready: true, restart count 1 May 21 21:35:11.503: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:35:11.503: INFO: Container discover ready: false, restart count 0 May 21 21:35:11.503: INFO: Container init ready: false, restart count 0 May 21 21:35:11.503: INFO: Container install ready: false, restart count 0 May 21 21:35:11.503: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.503: INFO: Container tas-controller ready: true, restart count 0 May 21 21:35:11.503: INFO: Container tas-extender ready: true, restart count 0 May 21 21:35:11.503: INFO: downward-api-1499468a-6e10-47f6-a735-09d7d997a784 started at 2021-05-21 21:33:48 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container dapi-container ready: false, restart count 0 May 21 21:35:11.503: INFO: downwardapi-volume-f61fdf73-4bb1-4c60-bcfe-2ef060d8784b started at 2021-05-21 21:35:07 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container client-container ready: false, restart count 0 May 21 21:35:11.503: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:35:11.503: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:35:11.503: INFO: Container collectd ready: true, restart count 0 May 21 21:35:11.503: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:35:11.503: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:35:11.503: INFO: foo-fbxdj started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container c ready: false, restart count 0 May 21 21:35:11.503: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:35:11.503: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:35:11.503: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.503: INFO: Container nodereport ready: true, restart count 0 May 21 21:35:11.503: INFO: Container reconcile ready: true, restart count 0 May 21 21:35:11.503: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:35:11.503: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:11.503: INFO: Container node-exporter ready: true, restart count 0 May 21 21:35:11.503: INFO: busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2 started at 2021-05-21 21:30:21 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2 ready: false, restart count 0 May 21 21:35:11.503: INFO: ss-0 started at 2021-05-21 21:33:14 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container webserver ready: false, restart count 0 May 21 21:35:11.503: INFO: foo-l9rbb started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container c ready: false, restart count 0 May 21 21:35:11.503: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:35:11.503: INFO: Init container install-cni ready: true, restart count 2 May 21 21:35:11.503: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:35:11.503: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:35:11.503: INFO: ss-0 started at 2021-05-21 21:25:26 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container webserver ready: false, restart count 0 May 21 21:35:11.503: INFO: pod-update-activedeadlineseconds-5540cee0-4476-496f-94f4-7fe4b1559547 started at 2021-05-21 21:30:12 +0000 UTC (0+1 container statuses recorded) May 21 21:35:11.503: INFO: Container nginx ready: false, restart count 0 W0521 21:35:11.513967 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:35:11.557: INFO: Latency metrics for node node2 May 21 21:35:11.557: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-probe-1911" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:40:16.391: wait for pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00" to succeed Expected success, but got an error: <*errors.errorString | 0xc004cc66d0>: { s: "Gave up after waiting 5m0s for pod \"busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00\" to be \"Succeeded or Failed\"", } Gave up after waiting 5m0s for pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00" to be "Succeeded or Failed" /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:212 [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:35:15.809: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:41 [It] should run the container with uid 65534 [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:35:15.845: INFO: Waiting up to 5m0s for pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00" in namespace "security-context-test-2773" to be "Succeeded or Failed" May 21 21:35:15.847: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2.478576ms May 21 21:35:17.850: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005629836s May 21 21:35:19.853: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008836693s May 21 21:35:21.856: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 6.011398194s May 21 21:35:23.859: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 8.014249522s May 21 21:35:25.861: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 10.01658324s May 21 21:35:27.865: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 12.020072807s May 21 21:35:29.868: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 14.02308262s May 21 21:35:31.870: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 16.025285463s May 21 21:35:33.873: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 18.028116903s May 21 21:35:35.876: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 20.031369348s May 21 21:35:37.879: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 22.034784975s May 21 21:35:39.883: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 24.038242287s May 21 21:35:41.886: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 26.041574954s May 21 21:35:43.889: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 28.044312318s May 21 21:35:45.892: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 30.047759752s May 21 21:35:47.898: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 32.052958743s May 21 21:35:49.903: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 34.058272835s May 21 21:35:51.910: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 36.065056864s May 21 21:35:53.914: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 38.069307827s May 21 21:35:55.917: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 40.072278696s May 21 21:35:57.922: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 42.077803516s May 21 21:35:59.927: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 44.08244301s May 21 21:36:01.932: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 46.087670748s May 21 21:36:03.936: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 48.091240019s May 21 21:36:05.938: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 50.093816971s May 21 21:36:07.946: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 52.101234903s May 21 21:36:09.950: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 54.105771552s May 21 21:36:11.953: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 56.108591151s May 21 21:36:13.958: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 58.112982173s May 21 21:36:15.961: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.11630416s May 21 21:36:17.966: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.12106947s May 21 21:36:19.969: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.124522443s May 21 21:36:21.974: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.129223453s May 21 21:36:23.978: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.132909831s May 21 21:36:25.981: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.136331645s May 21 21:36:27.986: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.141295876s May 21 21:36:29.990: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.145225021s May 21 21:36:31.994: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.149205099s May 21 21:36:33.999: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.154110206s May 21 21:36:36.001: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.156768855s May 21 21:36:38.006: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.161486874s May 21 21:36:40.009: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.16425638s May 21 21:36:42.012: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.16786448s May 21 21:36:44.020: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.175095007s May 21 21:36:46.023: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.178249566s May 21 21:36:48.027: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.182450255s May 21 21:36:50.030: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.184891598s May 21 21:36:52.033: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.188159875s May 21 21:36:54.036: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.191080392s May 21 21:36:56.039: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.194581645s May 21 21:36:58.042: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.197755033s May 21 21:37:00.046: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.201735914s May 21 21:37:02.050: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.205326606s May 21 21:37:04.053: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.208751692s May 21 21:37:06.057: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.212093117s May 21 21:37:08.060: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.215446435s May 21 21:37:10.065: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.219940371s May 21 21:37:12.068: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.223126954s May 21 21:37:14.073: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.228115213s May 21 21:37:16.077: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.231892789s May 21 21:37:18.080: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.235081376s May 21 21:37:20.082: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.237826908s May 21 21:37:22.086: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.241291604s May 21 21:37:24.089: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.244009151s May 21 21:37:26.092: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.247056509s May 21 21:37:28.096: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.251132006s May 21 21:37:30.100: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.255822993s May 21 21:37:32.107: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.262626874s May 21 21:37:34.110: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.265304054s May 21 21:37:36.114: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.26903306s May 21 21:37:38.117: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.272469614s May 21 21:37:40.120: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.27531406s May 21 21:37:42.123: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.278389491s May 21 21:37:44.126: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.281717998s May 21 21:37:46.129: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.284040826s May 21 21:37:48.133: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.288087026s May 21 21:37:50.136: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.291068352s May 21 21:37:52.140: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.295222427s May 21 21:37:54.143: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.297970011s May 21 21:37:56.145: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.30024098s May 21 21:37:58.148: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.303831237s May 21 21:38:00.151: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.306167032s May 21 21:38:02.154: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.309084596s May 21 21:38:04.156: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.311719826s May 21 21:38:06.160: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.315763269s May 21 21:38:08.166: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.321387853s May 21 21:38:10.170: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.325311786s May 21 21:38:12.174: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.329623759s May 21 21:38:14.178: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.332985511s May 21 21:38:16.181: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.335960035s May 21 21:38:18.186: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.34114097s May 21 21:38:20.192: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.346920143s May 21 21:38:22.195: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.350310386s May 21 21:38:24.198: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.353436231s May 21 21:38:26.201: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.356173451s May 21 21:38:28.205: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.359970731s May 21 21:38:30.207: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.362778251s May 21 21:38:32.210: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.365634993s May 21 21:38:34.213: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.368475463s May 21 21:38:36.217: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.372477931s May 21 21:38:38.221: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.37636655s May 21 21:38:40.225: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.380845758s May 21 21:38:42.229: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.384458268s May 21 21:38:44.233: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.388198228s May 21 21:38:46.235: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.390784097s May 21 21:38:48.239: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.394706921s May 21 21:38:50.243: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.398594438s May 21 21:38:52.248: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.403758646s May 21 21:38:54.251: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.406008719s May 21 21:38:56.253: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.408524703s May 21 21:38:58.256: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.411379896s May 21 21:39:00.259: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.414670423s May 21 21:39:02.262: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.41730368s May 21 21:39:04.265: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.420357715s May 21 21:39:06.268: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.423654862s May 21 21:39:08.271: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.426730179s May 21 21:39:10.274: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.42935304s May 21 21:39:12.277: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.432104276s May 21 21:39:14.280: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.434931539s May 21 21:39:16.284: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.439115598s May 21 21:39:18.287: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.442446431s May 21 21:39:20.291: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.445958529s May 21 21:39:22.295: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.450185825s May 21 21:39:24.297: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.45219158s May 21 21:39:26.300: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.455641853s May 21 21:39:28.304: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.459745832s May 21 21:39:30.307: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.46284661s May 21 21:39:32.311: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.466389162s May 21 21:39:34.314: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.469262691s May 21 21:39:36.316: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.471694077s May 21 21:39:38.320: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.474961833s May 21 21:39:40.323: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.478569601s May 21 21:39:42.328: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.483480226s May 21 21:39:44.331: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.485953114s May 21 21:39:46.334: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.489053276s May 21 21:39:48.338: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.493529168s May 21 21:39:50.340: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.495807239s May 21 21:39:52.343: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.498601722s May 21 21:39:54.346: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.501604411s May 21 21:39:56.349: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.504873835s May 21 21:39:58.354: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.509297334s May 21 21:40:00.359: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.514746432s May 21 21:40:02.365: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.520655107s May 21 21:40:04.368: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.523530025s May 21 21:40:06.372: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.527876886s May 21 21:40:08.377: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.532233179s May 21 21:40:10.380: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.535573911s May 21 21:40:12.385: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.540613757s May 21 21:40:14.389: INFO: Pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.544182144s May 21 21:40:16.391: FAIL: wait for pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00" to succeed Expected success, but got an error: <*errors.errorString | 0xc004cc66d0>: { s: "Gave up after waiting 5m0s for pod \"busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00\" to be \"Succeeded or Failed\"", } Gave up after waiting 5m0s for pod "busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00" to be "Succeeded or Failed" Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).WaitForSuccess(0xc002f4e2c0, 0xc005022bc0, 0x37, 0x45d964b800) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:212 +0x2bb k8s.io/kubernetes/test/e2e/common.glob..func29.2.2(0xfffe) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:74 +0x29a k8s.io/kubernetes/test/e2e/common.glob..func29.2.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:84 +0x2e k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00190b200, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-test-2773". STEP: Found 9 events. May 21 21:40:16.396: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00: { } Scheduled: Successfully assigned security-context-test-2773/busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00 to node1 May 21 21:40:16.396: INFO: At 2021-05-21 21:35:17 +0000 UTC - event for busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00: {multus } AddedInterface: Add eth0 [10.244.3.94/24] May 21 21:40:16.396: INFO: At 2021-05-21 21:35:17 +0000 UTC - event for busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:40:16.396: INFO: At 2021-05-21 21:35:18 +0000 UTC - event for busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:40:16.396: INFO: At 2021-05-21 21:35:18 +0000 UTC - event for busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00: {kubelet node1} Failed: Error: ErrImagePull May 21 21:40:16.396: INFO: At 2021-05-21 21:35:18 +0000 UTC - event for busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 21 21:40:16.396: INFO: At 2021-05-21 21:35:20 +0000 UTC - event for busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00: {multus } AddedInterface: Add eth0 [10.244.3.95/24] May 21 21:40:16.396: INFO: At 2021-05-21 21:35:20 +0000 UTC - event for busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:40:16.397: INFO: At 2021-05-21 21:35:20 +0000 UTC - event for busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00: {kubelet node1} Failed: Error: ImagePullBackOff May 21 21:40:16.399: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:40:16.399: INFO: busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:35:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:35:15 +0000 UTC ContainersNotReady containers with unready status: [busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:35:15 +0000 UTC ContainersNotReady containers with unready status: [busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:35:15 +0000 UTC }] May 21 21:40:16.399: INFO: May 21 21:40:16.404: INFO: Logging node info for node master1 May 21 21:40:16.407: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 37224 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:06 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:06 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:06 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:40:06 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:40:16.407: INFO: Logging kubelet events for node master1 May 21 21:40:16.409: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:40:16.416: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.416: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:40:16.416: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:40:16.416: INFO: Init container install-cni ready: true, restart count 0 May 21 21:40:16.416: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:40:16.416: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.416: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:40:16.416: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.416: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:40:16.416: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.416: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:40:16.417: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.417: INFO: Container kube-multus ready: true, restart count 1 May 21 21:40:16.417: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:40:16.417: INFO: Container docker-registry ready: true, restart count 0 May 21 21:40:16.417: INFO: Container nginx ready: true, restart count 0 May 21 21:40:16.417: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.417: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:40:16.417: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:40:16.417: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:40:16.417: INFO: Container node-exporter ready: true, restart count 0 W0521 21:40:16.429221 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:40:16.452: INFO: Latency metrics for node master1 May 21 21:40:16.452: INFO: Logging node info for node master2 May 21 21:40:16.455: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 37265 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:10 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:10 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:10 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:40:10 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:40:16.455: INFO: Logging kubelet events for node master2 May 21 21:40:16.457: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:40:16.466: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.466: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:40:16.466: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.466: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:40:16.466: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.466: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:40:16.466: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:40:16.466: INFO: Init container install-cni ready: true, restart count 0 May 21 21:40:16.466: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:40:16.466: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.466: INFO: Container kube-multus ready: true, restart count 1 May 21 21:40:16.466: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.466: INFO: Container autoscaler ready: true, restart count 2 May 21 21:40:16.466: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:40:16.466: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:40:16.466: INFO: Container node-exporter ready: true, restart count 0 May 21 21:40:16.466: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.466: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:40:16.466: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.466: INFO: Container coredns ready: true, restart count 1 W0521 21:40:16.480041 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:40:16.502: INFO: Latency metrics for node master2 May 21 21:40:16.502: INFO: Logging node info for node master3 May 21 21:40:16.504: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 37223 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:06 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:06 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:06 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:40:06 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:40:16.504: INFO: Logging kubelet events for node master3 May 21 21:40:16.507: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:40:16.512: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.512: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:40:16.512: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.512: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:40:16.512: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.512: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:40:16.512: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:40:16.512: INFO: Init container install-cni ready: true, restart count 0 May 21 21:40:16.512: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:40:16.512: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.512: INFO: Container kube-multus ready: true, restart count 1 May 21 21:40:16.512: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.512: INFO: Container coredns ready: true, restart count 1 May 21 21:40:16.512: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:40:16.512: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:40:16.512: INFO: Container node-exporter ready: true, restart count 0 May 21 21:40:16.512: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.512: INFO: Container kube-controller-manager ready: true, restart count 1 W0521 21:40:16.525889 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:40:16.553: INFO: Latency metrics for node master3 May 21 21:40:16.553: INFO: Logging node info for node node1 May 21 21:40:16.556: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 37278 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:11 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:11 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:11 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:40:11 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:40:16.556: INFO: Logging kubelet events for node node1 May 21 21:40:16.558: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:40:16.573: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:40:16.573: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:40:16.573: INFO: Container grafana ready: true, restart count 0 May 21 21:40:16.573: INFO: Container prometheus ready: true, restart count 1 May 21 21:40:16.573: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:40:16.573: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:40:16.573: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:40:16.573: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:40:16.573: INFO: Container nodereport ready: true, restart count 0 May 21 21:40:16.573: INFO: Container reconcile ready: true, restart count 0 May 21 21:40:16.573: INFO: var-expansion-4e42a31b-7838-4412-9bf2-9fcf678babe3 started at 2021-05-21 21:37:47 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container dapi-container ready: false, restart count 0 May 21 21:40:16.573: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:40:16.573: INFO: Init container install-cni ready: true, restart count 1 May 21 21:40:16.573: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:40:16.573: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:40:16.573: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:40:16.573: INFO: Container collectd ready: true, restart count 0 May 21 21:40:16.573: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:40:16.573: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:40:16.573: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:40:16.573: INFO: busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00 started at 2021-05-21 21:35:15 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00 ready: false, restart count 0 May 21 21:40:16.573: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:40:16.573: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:40:16.573: INFO: Container discover ready: false, restart count 0 May 21 21:40:16.573: INFO: Container init ready: false, restart count 0 May 21 21:40:16.573: INFO: Container install ready: false, restart count 0 May 21 21:40:16.573: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:40:16.573: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:40:16.573: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:40:16.573: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:40:16.573: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:40:16.573: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:40:16.573: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:40:16.573: INFO: Container node-exporter ready: true, restart count 0 May 21 21:40:16.573: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container kube-multus ready: true, restart count 1 May 21 21:40:16.573: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:40:16.573: INFO: pod-secrets-5286dcf7-bbee-4c29-9671-343e2fa6bad0 started at 2021-05-21 21:36:56 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.573: INFO: Container secret-env-test ready: false, restart count 0 W0521 21:40:16.586942 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:40:16.616: INFO: Latency metrics for node node1 May 21 21:40:16.616: INFO: Logging node info for node node2 May 21 21:40:16.619: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 37274 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:10 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:10 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:40:10 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:40:10 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:40:16.620: INFO: Logging kubelet events for node node2 May 21 21:40:16.622: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:40:16.634: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:40:16.634: INFO: Container tas-controller ready: true, restart count 0 May 21 21:40:16.634: INFO: Container tas-extender ready: true, restart count 0 May 21 21:40:16.634: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container kube-multus ready: true, restart count 1 May 21 21:40:16.634: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:40:16.634: INFO: Container discover ready: false, restart count 0 May 21 21:40:16.634: INFO: Container init ready: false, restart count 0 May 21 21:40:16.634: INFO: Container install ready: false, restart count 0 May 21 21:40:16.634: INFO: pod-232899ea-34e6-4d0c-bfe9-4c2371a27976 started at 2021-05-21 21:40:14 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container test-container ready: false, restart count 0 May 21 21:40:16.634: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:40:16.634: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:40:16.634: INFO: Container collectd ready: true, restart count 0 May 21 21:40:16.634: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:40:16.634: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:40:16.634: INFO: test-webserver-6f307d30-bbf2-41c6-9e1d-8202588d3d20 started at 2021-05-21 21:40:14 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container test-webserver ready: false, restart count 0 May 21 21:40:16.634: INFO: foo-fbxdj started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container c ready: false, restart count 0 May 21 21:40:16.634: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:40:16.634: INFO: Container nodereport ready: true, restart count 0 May 21 21:40:16.634: INFO: Container reconcile ready: true, restart count 0 May 21 21:40:16.634: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:40:16.634: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:40:16.634: INFO: Container node-exporter ready: true, restart count 0 May 21 21:40:16.634: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:40:16.634: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:40:16.634: INFO: ss-0 started at 2021-05-21 21:33:14 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container webserver ready: false, restart count 0 May 21 21:40:16.634: INFO: foo-l9rbb started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container c ready: false, restart count 0 May 21 21:40:16.634: INFO: termination-message-containerd0db43ea-8ded-4393-94c1-c3a86267cd01 started at 2021-05-21 21:37:39 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container termination-message-container ready: false, restart count 0 May 21 21:40:16.634: INFO: test-rollover-controller-9qcsx started at 2021-05-21 21:39:13 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container httpd ready: false, restart count 0 May 21 21:40:16.634: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:40:16.634: INFO: Init container install-cni ready: true, restart count 2 May 21 21:40:16.634: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:40:16.634: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:40:16.634: INFO: Container kube-sriovdp ready: true, restart count 0 W0521 21:40:16.647303 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:40:16.749: INFO: Latency metrics for node node2 May 21 21:40:16.749: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-test-2773" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:45:21.430: Unexpected error: <*errors.errorString | 0xc00112e520>: { s: "expected pod \"pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea\" success: Gave up after waiting 5m0s for pod \"pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea\" to be \"Succeeded or Failed\"", } expected pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea" success: Gave up after waiting 5m0s for pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:40:16.829: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable via the environment [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap configmap-2796/configmap-test-262a75a4-c778-4994-a315-b027c176d5ea STEP: Creating a pod to test consume configMaps May 21 21:40:16.865: INFO: Waiting up to 5m0s for pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea" in namespace "configmap-2796" to be "Succeeded or Failed" May 21 21:40:16.868: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2.642937ms May 21 21:40:18.872: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006400597s May 21 21:40:20.875: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009400567s May 21 21:40:22.878: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013083044s May 21 21:40:24.883: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 8.018095878s May 21 21:40:26.888: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 10.022577245s May 21 21:40:28.895: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 12.029894581s May 21 21:40:30.898: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 14.032811504s May 21 21:40:32.901: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 16.036161798s May 21 21:40:34.905: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 18.039589084s May 21 21:40:36.909: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 20.044291604s May 21 21:40:38.912: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 22.046655793s May 21 21:40:40.915: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 24.049392796s May 21 21:40:42.917: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 26.052000973s May 21 21:40:44.922: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 28.056597141s May 21 21:40:46.925: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 30.059570358s May 21 21:40:48.928: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 32.062993095s May 21 21:40:50.931: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 34.066128253s May 21 21:40:52.934: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 36.068994438s May 21 21:40:54.937: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 38.07173965s May 21 21:40:56.940: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 40.074947454s May 21 21:40:58.944: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 42.078447158s May 21 21:41:00.947: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 44.081851029s May 21 21:41:02.953: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 46.087732253s May 21 21:41:04.958: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 48.092997463s May 21 21:41:06.961: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 50.096220023s May 21 21:41:08.965: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 52.099881642s May 21 21:41:10.968: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 54.102706419s May 21 21:41:12.972: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 56.106786684s May 21 21:41:14.975: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 58.109768139s May 21 21:41:16.980: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.114472734s May 21 21:41:18.983: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.118276536s May 21 21:41:20.986: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.120888757s May 21 21:41:22.991: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.125606225s May 21 21:41:24.996: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.131046073s May 21 21:41:27.001: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.136042641s May 21 21:41:29.004: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.13871462s May 21 21:41:31.008: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.142546025s May 21 21:41:33.012: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.146522446s May 21 21:41:35.016: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.150691691s May 21 21:41:37.022: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.156431971s May 21 21:41:39.027: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.161570157s May 21 21:41:41.030: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.165049016s May 21 21:41:43.034: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.16925998s May 21 21:41:45.037: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.17188754s May 21 21:41:47.040: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.174842914s May 21 21:41:49.045: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.180157259s May 21 21:41:51.048: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.182983977s May 21 21:41:53.053: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.188142792s May 21 21:41:55.056: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.190963968s May 21 21:41:57.059: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.193536252s May 21 21:41:59.063: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.197988659s May 21 21:42:01.066: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.201062821s May 21 21:42:03.071: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.20611668s May 21 21:42:05.077: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.212014067s May 21 21:42:07.081: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.215418638s May 21 21:42:09.084: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.219191769s May 21 21:42:11.088: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.222552497s May 21 21:42:13.092: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.226969921s May 21 21:42:15.096: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.230831254s May 21 21:42:17.099: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.234265623s May 21 21:42:19.105: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.240018549s May 21 21:42:21.109: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.24343974s May 21 21:42:23.113: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.247804692s May 21 21:42:25.116: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.250637138s May 21 21:42:27.121: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.255710623s May 21 21:42:29.124: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.258425553s May 21 21:42:31.127: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.261493396s May 21 21:42:33.130: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.264885103s May 21 21:42:35.134: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.268943491s May 21 21:42:37.137: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.272062735s May 21 21:42:39.140: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.274922954s May 21 21:42:41.143: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.278055147s May 21 21:42:43.149: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.283926579s May 21 21:42:45.152: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.286831548s May 21 21:42:47.156: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.290767743s May 21 21:42:49.160: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.294898074s May 21 21:42:51.163: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.297596977s May 21 21:42:53.167: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.302298204s May 21 21:42:55.171: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.30571403s May 21 21:42:57.173: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.308095907s May 21 21:42:59.176: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.311282352s May 21 21:43:01.180: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.314515558s May 21 21:43:03.182: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.317278661s May 21 21:43:05.186: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.321108451s May 21 21:43:07.190: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.324764462s May 21 21:43:09.192: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.32731902s May 21 21:43:11.195: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.330198406s May 21 21:43:13.199: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.333411351s May 21 21:43:15.202: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.336649427s May 21 21:43:17.205: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.339968671s May 21 21:43:19.208: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.343007429s May 21 21:43:21.212: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.346608492s May 21 21:43:23.216: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.350573814s May 21 21:43:25.218: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.353032135s May 21 21:43:27.222: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.356520395s May 21 21:43:29.224: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.359160692s May 21 21:43:31.228: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.362678221s May 21 21:43:33.230: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.365078871s May 21 21:43:35.234: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.368763612s May 21 21:43:37.237: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.37143452s May 21 21:43:39.240: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.374473169s May 21 21:43:41.243: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.377358455s May 21 21:43:43.246: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.380537729s May 21 21:43:45.249: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.383491475s May 21 21:43:47.253: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.387406665s May 21 21:43:49.255: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.390219687s May 21 21:43:51.260: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.394469346s May 21 21:43:53.262: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.397324616s May 21 21:43:55.266: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.401319675s May 21 21:43:57.270: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.405020079s May 21 21:43:59.274: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.40894117s May 21 21:44:01.278: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.41301951s May 21 21:44:03.286: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.420537512s May 21 21:44:05.289: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.423908411s May 21 21:44:07.292: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.427327771s May 21 21:44:09.297: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.431656408s May 21 21:44:11.301: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.435407477s May 21 21:44:13.303: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.438161494s May 21 21:44:15.307: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.442210963s May 21 21:44:17.310: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.445319071s May 21 21:44:19.313: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.448260365s May 21 21:44:21.316: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.450639881s May 21 21:44:23.319: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.453398084s May 21 21:44:25.321: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.456288961s May 21 21:44:27.325: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.45934845s May 21 21:44:29.328: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.463230335s May 21 21:44:31.333: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.467417337s May 21 21:44:33.335: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.4700633s May 21 21:44:35.338: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.473270113s May 21 21:44:37.341: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.476253027s May 21 21:44:39.344: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.479061053s May 21 21:44:41.347: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.481794927s May 21 21:44:43.351: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.485740203s May 21 21:44:45.354: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.489168727s May 21 21:44:47.359: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.493925509s May 21 21:44:49.362: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.496416622s May 21 21:44:51.364: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.498746901s May 21 21:44:53.367: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.502122103s May 21 21:44:55.373: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.507415948s May 21 21:44:57.376: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.510411821s May 21 21:44:59.379: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.51399215s May 21 21:45:01.381: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.516162137s May 21 21:45:03.384: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.51867155s May 21 21:45:05.390: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.524552329s May 21 21:45:07.394: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.52859811s May 21 21:45:09.396: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.531036523s May 21 21:45:11.399: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.533561865s May 21 21:45:13.402: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.536483695s May 21 21:45:15.408: INFO: Pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.542774184s May 21 21:45:17.418: INFO: Failed to get logs from node "node2" pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea" container "env-test": the server rejected our request for an unknown reason (get pods pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea) STEP: delete the pod May 21 21:45:17.424: INFO: Waiting for pod pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea to disappear May 21 21:45:17.427: INFO: Pod pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea still exists May 21 21:45:19.427: INFO: Waiting for pod pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea to disappear May 21 21:45:19.430: INFO: Pod pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea still exists May 21 21:45:21.428: INFO: Waiting for pod pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea to disappear May 21 21:45:21.430: INFO: Pod pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea no longer exists May 21 21:45:21.430: FAIL: Unexpected error: <*errors.errorString | 0xc00112e520>: { s: "expected pod \"pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea\" success: Gave up after waiting 5m0s for pod \"pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea\" to be \"Succeeded or Failed\"", } expected pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea" success: Gave up after waiting 5m0s for pod "pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0003a8dc0, 0x4c18c6e, 0x12, 0xc000801400, 0x0, 0xc00107b178, 0x6, 0x6, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func1.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap.go:124 +0x954 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00190b200, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "configmap-2796". STEP: Found 7 events. May 21 21:45:21.435: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea: { } Scheduled: Successfully assigned configmap-2796/pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea to node2 May 21 21:45:21.435: INFO: At 2021-05-21 21:40:18 +0000 UTC - event for pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea: {multus } AddedInterface: Add eth0 [10.244.4.204/24] May 21 21:45:21.435: INFO: At 2021-05-21 21:40:18 +0000 UTC - event for pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:45:21.435: INFO: At 2021-05-21 21:40:19 +0000 UTC - event for pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:45:21.435: INFO: At 2021-05-21 21:40:19 +0000 UTC - event for pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea: {kubelet node2} Failed: Error: ErrImagePull May 21 21:45:21.435: INFO: At 2021-05-21 21:40:19 +0000 UTC - event for pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:45:21.435: INFO: At 2021-05-21 21:40:19 +0000 UTC - event for pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:45:21.438: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:45:21.438: INFO: May 21 21:45:21.442: INFO: Logging node info for node master1 May 21 21:45:21.445: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 40511 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:17 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:17 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:17 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:45:17 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:45:21.446: INFO: Logging kubelet events for node master1 May 21 21:45:21.449: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:45:21.457: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.457: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:45:21.457: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.457: INFO: Container kube-multus ready: true, restart count 1 May 21 21:45:21.457: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.457: INFO: Container docker-registry ready: true, restart count 0 May 21 21:45:21.457: INFO: Container nginx ready: true, restart count 0 May 21 21:45:21.457: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.457: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:45:21.457: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.457: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:45:21.457: INFO: Container node-exporter ready: true, restart count 0 May 21 21:45:21.457: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.457: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:45:21.457: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.457: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:45:21.457: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.457: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:45:21.457: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:45:21.457: INFO: Init container install-cni ready: true, restart count 0 May 21 21:45:21.457: INFO: Container kube-flannel ready: true, restart count 2 W0521 21:45:21.468279 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:45:21.492: INFO: Latency metrics for node master1 May 21 21:45:21.493: INFO: Logging node info for node master2 May 21 21:45:21.494: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 40526 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:21 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:21 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:21 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:45:21 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:45:21.495: INFO: Logging kubelet events for node master2 May 21 21:45:21.496: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:45:21.505: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.505: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:45:21.505: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.505: INFO: Container coredns ready: true, restart count 1 May 21 21:45:21.505: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.505: INFO: Container autoscaler ready: true, restart count 2 May 21 21:45:21.505: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.505: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:45:21.505: INFO: Container node-exporter ready: true, restart count 0 May 21 21:45:21.505: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.505: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:45:21.505: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.505: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:45:21.505: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.505: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:45:21.505: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:45:21.505: INFO: Init container install-cni ready: true, restart count 0 May 21 21:45:21.505: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:45:21.505: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.505: INFO: Container kube-multus ready: true, restart count 1 W0521 21:45:21.519618 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:45:21.547: INFO: Latency metrics for node master2 May 21 21:45:21.547: INFO: Logging node info for node master3 May 21 21:45:21.550: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 40510 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:17 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:17 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:17 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:45:17 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:45:21.551: INFO: Logging kubelet events for node master3 May 21 21:45:21.553: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:45:21.560: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:45:21.560: INFO: Init container install-cni ready: true, restart count 0 May 21 21:45:21.560: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:45:21.560: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.560: INFO: Container kube-multus ready: true, restart count 1 May 21 21:45:21.560: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.560: INFO: Container coredns ready: true, restart count 1 May 21 21:45:21.560: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.560: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:45:21.561: INFO: Container node-exporter ready: true, restart count 0 May 21 21:45:21.561: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.561: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:45:21.561: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.561: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:45:21.561: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.561: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:45:21.561: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.561: INFO: Container kube-proxy ready: true, restart count 2 W0521 21:45:21.574228 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:45:21.596: INFO: Latency metrics for node master3 May 21 21:45:21.596: INFO: Logging node info for node node1 May 21 21:45:21.599: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 40503 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:15 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:15 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:15 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:45:15 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:45:21.600: INFO: Logging kubelet events for node node1 May 21 21:45:21.602: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:45:21.627: INFO: pod-init-3a218723-a89e-4381-82d5-b9684848a992 started at 2021-05-21 21:42:03 +0000 UTC (2+1 container statuses recorded) May 21 21:45:21.627: INFO: Init container init1 ready: false, restart count 0 May 21 21:45:21.627: INFO: Init container init2 ready: false, restart count 0 May 21 21:45:21.627: INFO: Container run1 ready: false, restart count 0 May 21 21:45:21.627: INFO: pod-init-2ec58da9-36da-4b8a-b115-720b8ba8e13b started at 2021-05-21 21:44:40 +0000 UTC (2+1 container statuses recorded) May 21 21:45:21.627: INFO: Init container init1 ready: false, restart count 0 May 21 21:45:21.627: INFO: Init container init2 ready: false, restart count 0 May 21 21:45:21.627: INFO: Container run1 ready: false, restart count 0 May 21 21:45:21.627: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.627: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:45:21.627: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.627: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:45:21.627: INFO: busybox-host-aliases44a891b1-46fb-41d0-8db8-b1e1a24c66ef started at 2021-05-21 21:42:01 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.627: INFO: Container busybox-host-aliases44a891b1-46fb-41d0-8db8-b1e1a24c66ef ready: false, restart count 0 May 21 21:45:21.627: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.627: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:45:21.627: INFO: Container node-exporter ready: true, restart count 0 May 21 21:45:21.627: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.627: INFO: Container kube-multus ready: true, restart count 1 May 21 21:45:21.627: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.627: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:45:21.627: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.627: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:45:21.627: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:45:21.628: INFO: pod-adoption started at 2021-05-21 21:43:33 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.628: INFO: Container pod-adoption ready: false, restart count 0 May 21 21:45:21.628: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.628: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:45:21.628: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.628: INFO: Container nodereport ready: true, restart count 0 May 21 21:45:21.628: INFO: Container reconcile ready: true, restart count 0 May 21 21:45:21.628: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:45:21.628: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:45:21.628: INFO: Container grafana ready: true, restart count 0 May 21 21:45:21.628: INFO: Container prometheus ready: true, restart count 1 May 21 21:45:21.628: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:45:21.628: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:45:21.628: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:45:21.628: INFO: Init container install-cni ready: true, restart count 1 May 21 21:45:21.628: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:45:21.628: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.628: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:45:21.628: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:45:21.628: INFO: Container collectd ready: true, restart count 0 May 21 21:45:21.628: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:45:21.628: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:45:21.628: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.628: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:45:21.628: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.628: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:45:21.628: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:45:21.628: INFO: Container discover ready: false, restart count 0 May 21 21:45:21.628: INFO: Container init ready: false, restart count 0 May 21 21:45:21.628: INFO: Container install ready: false, restart count 0 W0521 21:45:21.639989 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:45:21.679: INFO: Latency metrics for node node1 May 21 21:45:21.679: INFO: Logging node info for node node2 May 21 21:45:21.682: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 40487 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:12 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:12 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:45:12 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:45:12 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:45:21.682: INFO: Logging kubelet events for node node2 May 21 21:45:21.685: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:45:21.698: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:45:21.698: INFO: Container collectd ready: true, restart count 0 May 21 21:45:21.698: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:45:21.698: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:45:21.698: INFO: adopt-release-xf7hc started at 2021-05-21 21:41:11 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container c ready: false, restart count 0 May 21 21:45:21.698: INFO: foo-fbxdj started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container c ready: false, restart count 0 May 21 21:45:21.698: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.698: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:45:21.698: INFO: Container node-exporter ready: true, restart count 0 May 21 21:45:21.698: INFO: busybox-31d82853-0ab7-4147-8cd3-52c6c6a07033 started at 2021-05-21 21:43:52 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container busybox ready: false, restart count 0 May 21 21:45:21.698: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:45:21.698: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:45:21.698: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.698: INFO: Container nodereport ready: true, restart count 0 May 21 21:45:21.698: INFO: Container reconcile ready: true, restart count 0 May 21 21:45:21.698: INFO: pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973 started at 2021-05-21 21:42:54 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.698: INFO: Container busybox-main-container ready: false, restart count 0 May 21 21:45:21.698: INFO: Container busybox-sub-container ready: false, restart count 0 May 21 21:45:21.698: INFO: foo-l9rbb started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container c ready: false, restart count 0 May 21 21:45:21.698: INFO: adopt-release-n9wdj started at 2021-05-21 21:41:11 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container c ready: false, restart count 0 May 21 21:45:21.698: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:45:21.698: INFO: Init container install-cni ready: true, restart count 2 May 21 21:45:21.698: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:45:21.698: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:45:21.698: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container kube-multus ready: true, restart count 1 May 21 21:45:21.698: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:45:21.698: INFO: Container discover ready: false, restart count 0 May 21 21:45:21.698: INFO: Container init ready: false, restart count 0 May 21 21:45:21.698: INFO: Container install ready: false, restart count 0 May 21 21:45:21.698: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:45:21.698: INFO: Container tas-controller ready: true, restart count 0 May 21 21:45:21.698: INFO: Container tas-extender ready: true, restart count 0 May 21 21:45:21.698: INFO: e2e-test-httpd-pod started at 2021-05-21 21:43:04 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container e2e-test-httpd-pod ready: false, restart count 0 May 21 21:45:21.698: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:45:21.698: INFO: Container nginx-proxy ready: true, restart count 2 W0521 21:45:21.711228 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:45:21.741: INFO: Latency metrics for node node2 May 21 21:45:21.741: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-2796" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:51:41.886: Expected <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } to be nil /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:432 [BeforeEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:46:41.850: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename init-container STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:162 [It] should not start app containers if init containers fail on a RestartAlways pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod May 21 21:46:41.871: INFO: PodSpec: initContainers in spec.initContainers May 21 21:51:41.886: FAIL: Expected <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } to be nil Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func11.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:432 +0xcaf k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00190b200, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "init-container-1574". STEP: Found 7 events. May 21 21:51:41.891: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf: { } Scheduled: Successfully assigned init-container-1574/pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf to node2 May 21 21:51:41.891: INFO: At 2021-05-21 21:46:45 +0000 UTC - event for pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf: {multus } AddedInterface: Add eth0 [10.244.4.238/24] May 21 21:51:41.891: INFO: At 2021-05-21 21:46:45 +0000 UTC - event for pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:51:41.891: INFO: At 2021-05-21 21:46:46 +0000 UTC - event for pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:51:41.891: INFO: At 2021-05-21 21:46:46 +0000 UTC - event for pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf: {kubelet node2} Failed: Error: ErrImagePull May 21 21:51:41.891: INFO: At 2021-05-21 21:46:46 +0000 UTC - event for pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:51:41.891: INFO: At 2021-05-21 21:46:46 +0000 UTC - event for pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:51:41.893: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:51:41.893: INFO: pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf node2 Pending [{Initialized False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:46:41 +0000 UTC ContainersNotInitialized containers with incomplete status: [init1 init2]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:46:41 +0000 UTC ContainersNotReady containers with unready status: [run1]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:46:41 +0000 UTC ContainersNotReady containers with unready status: [run1]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:46:41 +0000 UTC }] May 21 21:51:41.893: INFO: May 21 21:51:41.897: INFO: Logging node info for node master1 May 21 21:51:41.899: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 44673 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:39 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:39 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:39 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:51:39 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:51:41.900: INFO: Logging kubelet events for node master1 May 21 21:51:41.903: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:51:41.913: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:51:41.913: INFO: Init container install-cni ready: true, restart count 0 May 21 21:51:41.913: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:51:41.913: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.913: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:51:41.913: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.913: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:51:41.913: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.913: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:51:41.913: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.913: INFO: Container kube-multus ready: true, restart count 1 May 21 21:51:41.913: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:51:41.913: INFO: Container docker-registry ready: true, restart count 0 May 21 21:51:41.913: INFO: Container nginx ready: true, restart count 0 May 21 21:51:41.914: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.914: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:51:41.914: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:51:41.914: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:51:41.914: INFO: Container node-exporter ready: true, restart count 0 May 21 21:51:41.914: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.914: INFO: Container kube-scheduler ready: true, restart count 0 W0521 21:51:41.926917 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:51:41.954: INFO: Latency metrics for node master1 May 21 21:51:41.954: INFO: Logging node info for node master2 May 21 21:51:41.956: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 44650 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:32 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:32 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:32 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:51:32 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:51:41.956: INFO: Logging kubelet events for node master2 May 21 21:51:41.958: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:51:41.966: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:51:41.966: INFO: Init container install-cni ready: true, restart count 0 May 21 21:51:41.966: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:51:41.966: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.966: INFO: Container kube-multus ready: true, restart count 1 May 21 21:51:41.966: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.966: INFO: Container autoscaler ready: true, restart count 2 May 21 21:51:41.966: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:51:41.966: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:51:41.966: INFO: Container node-exporter ready: true, restart count 0 May 21 21:51:41.966: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.966: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:51:41.966: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.966: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:51:41.966: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.966: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:51:41.966: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.966: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:51:41.966: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:51:41.966: INFO: Container coredns ready: true, restart count 1 W0521 21:51:41.977519 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:51:42.007: INFO: Latency metrics for node master2 May 21 21:51:42.007: INFO: Logging node info for node master3 May 21 21:51:42.009: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 44672 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:39 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:39 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:39 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:51:39 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:51:42.009: INFO: Logging kubelet events for node master3 May 21 21:51:42.011: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:51:42.019: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.019: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:51:42.019: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.019: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:51:42.019: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.019: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:51:42.019: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.019: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:51:42.019: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:51:42.019: INFO: Init container install-cni ready: true, restart count 0 May 21 21:51:42.019: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:51:42.019: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.019: INFO: Container kube-multus ready: true, restart count 1 May 21 21:51:42.019: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.019: INFO: Container coredns ready: true, restart count 1 May 21 21:51:42.019: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:51:42.019: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:51:42.019: INFO: Container node-exporter ready: true, restart count 0 W0521 21:51:42.032022 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:51:42.054: INFO: Latency metrics for node master3 May 21 21:51:42.054: INFO: Logging node info for node node1 May 21 21:51:42.057: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 44681 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:41 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:41 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:41 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:51:41 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:51:42.058: INFO: Logging kubelet events for node node1 May 21 21:51:42.060: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:51:42.076: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.076: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:51:42.076: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.076: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:51:42.076: INFO: var-expansion-f2a290f8-c2af-48aa-a767-0103a23cfdeb started at 2021-05-21 21:49:41 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.076: INFO: Container dapi-container ready: false, restart count 0 May 21 21:51:42.076: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.076: INFO: Container kube-multus ready: true, restart count 1 May 21 21:51:42.076: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.076: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:51:42.076: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:51:42.076: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:51:42.076: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:51:42.076: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:51:42.076: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:51:42.076: INFO: Container node-exporter ready: true, restart count 0 May 21 21:51:42.076: INFO: pod-submit-remove-77f7e5f0-2e1c-4de6-9e34-421ef3c1c2fb started at 2021-05-21 21:48:33 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.076: INFO: Container nginx ready: false, restart count 0 May 21 21:51:42.076: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.076: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:51:42.076: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:51:42.076: INFO: Container nodereport ready: true, restart count 0 May 21 21:51:42.076: INFO: Container reconcile ready: true, restart count 0 May 21 21:51:42.076: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:51:42.076: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:51:42.076: INFO: Container grafana ready: true, restart count 0 May 21 21:51:42.076: INFO: Container prometheus ready: true, restart count 1 May 21 21:51:42.076: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:51:42.076: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:51:42.076: INFO: pod-configmaps-ea1acaf6-4cca-480d-83ac-a7a22ea561d5 started at 2021-05-21 21:50:35 +0000 UTC (0+3 container statuses recorded) May 21 21:51:42.076: INFO: Container createcm-volume-test ready: true, restart count 0 May 21 21:51:42.076: INFO: Container delcm-volume-test ready: true, restart count 0 May 21 21:51:42.076: INFO: Container updcm-volume-test ready: true, restart count 0 May 21 21:51:42.076: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:51:42.076: INFO: Init container install-cni ready: true, restart count 1 May 21 21:51:42.076: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:51:42.076: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.076: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:51:42.076: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:51:42.076: INFO: Container collectd ready: true, restart count 0 May 21 21:51:42.076: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:51:42.076: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:51:42.076: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.076: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:51:42.076: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.076: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:51:42.076: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:51:42.076: INFO: Container discover ready: false, restart count 0 May 21 21:51:42.076: INFO: Container init ready: false, restart count 0 May 21 21:51:42.076: INFO: Container install ready: false, restart count 0 W0521 21:51:42.089394 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:51:42.119: INFO: Latency metrics for node node1 May 21 21:51:42.119: INFO: Logging node info for node node2 May 21 21:51:42.121: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 44661 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:35 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:35 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:51:35 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:51:35 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:51:42.122: INFO: Logging kubelet events for node node2 May 21 21:51:42.123: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:51:42.136: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:51:42.136: INFO: bin-falseb60b7859-07df-4a9d-8e7f-301dc83357a5 started at 2021-05-21 21:50:57 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container bin-falseb60b7859-07df-4a9d-8e7f-301dc83357a5 ready: false, restart count 0 May 21 21:51:42.136: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:51:42.136: INFO: Container collectd ready: true, restart count 0 May 21 21:51:42.136: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:51:42.136: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:51:42.136: INFO: adopt-release-xf7hc started at 2021-05-21 21:41:11 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container c ready: false, restart count 0 May 21 21:51:42.136: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:51:42.136: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:51:42.136: INFO: Container nodereport ready: true, restart count 0 May 21 21:51:42.136: INFO: Container reconcile ready: true, restart count 0 May 21 21:51:42.136: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:51:42.136: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:51:42.136: INFO: Container node-exporter ready: true, restart count 0 May 21 21:51:42.136: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:51:42.136: INFO: adopt-release-n9wdj started at 2021-05-21 21:41:11 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container c ready: false, restart count 0 May 21 21:51:42.136: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:51:42.136: INFO: pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf started at 2021-05-21 21:46:41 +0000 UTC (2+1 container statuses recorded) May 21 21:51:42.136: INFO: Init container init1 ready: false, restart count 0 May 21 21:51:42.136: INFO: Init container init2 ready: false, restart count 0 May 21 21:51:42.136: INFO: Container run1 ready: false, restart count 0 May 21 21:51:42.136: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:51:42.136: INFO: Init container install-cni ready: true, restart count 2 May 21 21:51:42.136: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:51:42.136: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:51:42.136: INFO: Container discover ready: false, restart count 0 May 21 21:51:42.136: INFO: Container init ready: false, restart count 0 May 21 21:51:42.136: INFO: Container install ready: false, restart count 0 May 21 21:51:42.136: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:51:42.136: INFO: Container tas-controller ready: true, restart count 0 May 21 21:51:42.136: INFO: Container tas-extender ready: true, restart count 0 May 21 21:51:42.136: INFO: busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b started at 2021-05-21 21:47:55 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b ready: false, restart count 0 May 21 21:51:42.136: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container kube-multus ready: true, restart count 1 May 21 21:51:42.136: INFO: terminate-cmd-rpa00907814-0b7b-4354-89ed-e127f8270277 started at 2021-05-21 21:48:02 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container terminate-cmd-rpa ready: false, restart count 0 May 21 21:51:42.136: INFO: var-expansion-b916002b-36f8-432b-ac19-25ef62c55a04 started at 2021-05-21 21:51:08 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container dapi-container ready: false, restart count 0 May 21 21:51:42.136: INFO: e2e-test-httpd-pod started at 2021-05-21 21:43:04 +0000 UTC (0+1 container statuses recorded) May 21 21:51:42.136: INFO: Container e2e-test-httpd-pod ready: false, restart count 0 W0521 21:51:42.149658 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:51:42.197: INFO: Latency metrics for node node2 May 21 21:51:42.197: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "init-container-1574" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:57:11.798: Timed out after 300.001s. Expected <v1.PodPhase>: Pending to equal <v1.PodPhase>: Succeeded /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 [BeforeEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:52:11.765: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-runtime STEP: Waiting for a default service account to be provisioned in namespace [It] should report termination message [LinuxOnly] as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the container STEP: wait for the container to reach Succeeded May 21 21:57:11.798: FAIL: Timed out after 300.001s. Expected <v1.PodPhase>: Pending to equal <v1.PodPhase>: Succeeded Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func25.1.2.1(0x4c5d8a0, 0x1d, 0xc0004aa160, 0x1e, 0xc0047cfcc0, 0x2, 0x2, 0xc00386c4b0, 0x1, 0x1, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 +0x3f1 k8s.io/kubernetes/test/e2e/common.glob..func25.1.2.5() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:245 +0x1d2 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00190b200) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00190b200, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "container-runtime-7270". STEP: Found 9 events. May 21 21:57:11.811: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for termination-message-container00118259-bf56-4793-9429-ad99949e3c32: { } Scheduled: Successfully assigned container-runtime-7270/termination-message-container00118259-bf56-4793-9429-ad99949e3c32 to node1 May 21 21:57:11.811: INFO: At 2021-05-21 21:52:14 +0000 UTC - event for termination-message-container00118259-bf56-4793-9429-ad99949e3c32: {multus } AddedInterface: Add eth0 [10.244.3.163/24] May 21 21:57:11.811: INFO: At 2021-05-21 21:52:14 +0000 UTC - event for termination-message-container00118259-bf56-4793-9429-ad99949e3c32: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:57:11.811: INFO: At 2021-05-21 21:52:15 +0000 UTC - event for termination-message-container00118259-bf56-4793-9429-ad99949e3c32: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:57:11.811: INFO: At 2021-05-21 21:52:15 +0000 UTC - event for termination-message-container00118259-bf56-4793-9429-ad99949e3c32: {kubelet node1} Failed: Error: ErrImagePull May 21 21:57:11.811: INFO: At 2021-05-21 21:52:19 +0000 UTC - event for termination-message-container00118259-bf56-4793-9429-ad99949e3c32: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 21 21:57:11.811: INFO: At 2021-05-21 21:52:24 +0000 UTC - event for termination-message-container00118259-bf56-4793-9429-ad99949e3c32: {multus } AddedInterface: Add eth0 [10.244.3.167/24] May 21 21:57:11.811: INFO: At 2021-05-21 21:52:24 +0000 UTC - event for termination-message-container00118259-bf56-4793-9429-ad99949e3c32: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:57:11.811: INFO: At 2021-05-21 21:52:24 +0000 UTC - event for termination-message-container00118259-bf56-4793-9429-ad99949e3c32: {kubelet node1} Failed: Error: ImagePullBackOff May 21 21:57:11.813: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:57:11.813: INFO: May 21 21:57:11.817: INFO: Logging node info for node master1 May 21 21:57:11.819: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 47416 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:10 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:10 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:10 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:57:10 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:57:11.820: INFO: Logging kubelet events for node master1 May 21 21:57:11.822: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:57:11.830: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.830: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:57:11.830: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:57:11.830: INFO: Init container install-cni ready: true, restart count 0 May 21 21:57:11.830: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:57:11.830: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.830: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:57:11.830: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.830: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:57:11.830: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.830: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:57:11.830: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.830: INFO: Container kube-multus ready: true, restart count 1 May 21 21:57:11.830: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:57:11.830: INFO: Container docker-registry ready: true, restart count 0 May 21 21:57:11.830: INFO: Container nginx ready: true, restart count 0 May 21 21:57:11.830: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.831: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:57:11.831: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:57:11.831: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:57:11.831: INFO: Container node-exporter ready: true, restart count 0 W0521 21:57:11.843696 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:57:11.868: INFO: Latency metrics for node master1 May 21 21:57:11.868: INFO: Logging node info for node master2 May 21 21:57:11.870: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 47382 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:03 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:03 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:03 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:57:03 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:57:11.871: INFO: Logging kubelet events for node master2 May 21 21:57:11.872: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:57:11.881: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.881: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:57:11.881: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.881: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:57:11.881: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.881: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:57:11.881: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:57:11.881: INFO: Init container install-cni ready: true, restart count 0 May 21 21:57:11.881: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:57:11.881: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.881: INFO: Container kube-multus ready: true, restart count 1 May 21 21:57:11.881: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.881: INFO: Container autoscaler ready: true, restart count 2 May 21 21:57:11.881: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:57:11.881: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:57:11.882: INFO: Container node-exporter ready: true, restart count 0 May 21 21:57:11.882: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.882: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:57:11.882: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.882: INFO: Container coredns ready: true, restart count 1 W0521 21:57:11.895228 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:57:11.923: INFO: Latency metrics for node master2 May 21 21:57:11.923: INFO: Logging node info for node master3 May 21 21:57:11.925: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 47417 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:10 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:10 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:10 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:57:10 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:57:11.925: INFO: Logging kubelet events for node master3 May 21 21:57:11.927: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:57:11.935: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.935: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:57:11.935: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.935: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:57:11.935: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.935: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:57:11.935: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.935: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:57:11.935: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:57:11.935: INFO: Init container install-cni ready: true, restart count 0 May 21 21:57:11.935: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:57:11.935: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.935: INFO: Container kube-multus ready: true, restart count 1 May 21 21:57:11.935: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:57:11.935: INFO: Container coredns ready: true, restart count 1 May 21 21:57:11.935: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:57:11.935: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:57:11.935: INFO: Container node-exporter ready: true, restart count 0 W0521 21:57:11.947246 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:57:11.970: INFO: Latency metrics for node master3 May 21 21:57:11.970: INFO: Logging node info for node node1 May 21 21:57:11.972: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 47389 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:04 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:04 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:04 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:57:04 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:57:11.973: INFO: Logging kubelet events for node node1 May 21 21:57:11.975: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:57:12.116: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:57:12.116: INFO: Init container install-cni ready: true, restart count 1 May 21 21:57:12.116: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:57:12.116: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.116: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:57:12.116: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:57:12.116: INFO: Container collectd ready: true, restart count 0 May 21 21:57:12.116: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:57:12.116: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:57:12.116: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.116: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:57:12.116: INFO: test-cleanup-controller-gc8rs started at 2021-05-21 21:53:16 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.116: INFO: Container httpd ready: false, restart count 0 May 21 21:57:12.116: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.116: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:57:12.116: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:57:12.116: INFO: Container discover ready: false, restart count 0 May 21 21:57:12.116: INFO: Container init ready: false, restart count 0 May 21 21:57:12.116: INFO: Container install ready: false, restart count 0 May 21 21:57:12.116: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.116: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:57:12.116: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.116: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:57:12.116: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.116: INFO: Container kube-multus ready: true, restart count 1 May 21 21:57:12.116: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.116: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:57:12.116: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:57:12.116: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:57:12.116: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:57:12.116: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:57:12.116: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:57:12.116: INFO: Container node-exporter ready: true, restart count 0 May 21 21:57:12.116: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.116: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:57:12.116: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:57:12.116: INFO: Container nodereport ready: true, restart count 0 May 21 21:57:12.116: INFO: Container reconcile ready: true, restart count 0 May 21 21:57:12.116: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:57:12.116: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:57:12.116: INFO: Container grafana ready: true, restart count 0 May 21 21:57:12.116: INFO: Container prometheus ready: true, restart count 1 May 21 21:57:12.116: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:57:12.116: INFO: Container rules-configmap-reloader ready: true, restart count 0 W0521 21:57:12.130249 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:57:12.174: INFO: Latency metrics for node node1 May 21 21:57:12.174: INFO: Logging node info for node node2 May 21 21:57:12.177: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 47404 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:08 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:08 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:57:08 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:57:08 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:57:12.178: INFO: Logging kubelet events for node node2 May 21 21:57:12.180: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:57:12.190: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.190: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:57:12.190: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:57:12.190: INFO: Container collectd ready: true, restart count 0 May 21 21:57:12.190: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:57:12.191: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:57:12.191: INFO: pod-exec-websocket-c42047a5-f86d-421b-8344-374e5f522893 started at 2021-05-21 21:54:42 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.191: INFO: Container main ready: false, restart count 0 May 21 21:57:12.191: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.191: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:57:12.191: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.191: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:57:12.191: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:57:12.191: INFO: Container nodereport ready: true, restart count 0 May 21 21:57:12.191: INFO: Container reconcile ready: true, restart count 0 May 21 21:57:12.191: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:57:12.191: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:57:12.191: INFO: Container node-exporter ready: true, restart count 0 May 21 21:57:12.191: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:57:12.191: INFO: Init container install-cni ready: true, restart count 2 May 21 21:57:12.191: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:57:12.191: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.191: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:57:12.191: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:57:12.191: INFO: Container kube-multus ready: true, restart count 1 May 21 21:57:12.191: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:57:12.191: INFO: Container discover ready: false, restart count 0 May 21 21:57:12.191: INFO: Container init ready: false, restart count 0 May 21 21:57:12.191: INFO: Container install ready: false, restart count 0 May 21 21:57:12.191: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:57:12.191: INFO: Container tas-controller ready: true, restart count 0 May 21 21:57:12.191: INFO: Container tas-extender ready: true, restart count 0 W0521 21:57:12.203924 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:57:12.234: INFO: Latency metrics for node node2 May 21 21:57:12.234: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-runtime-7270" for this suite.