/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:26:54.768: Unexpected error: <*errors.errorString | 0xc004bf7560>: { s: "expected pod \"pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca\" success: Gave up after waiting 5m0s for pod \"pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca\" to be \"Succeeded or Failed\"", } expected pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca" success: Gave up after waiting 5m0s for pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:21:42.139: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name secret-test-78b59e92-0a20-4700-8395-612122a20c27 STEP: Creating a pod to test consume secrets May 7 21:21:42.177: INFO: Waiting up to 5m0s for pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca" in namespace "secrets-558" to be "Succeeded or Failed" May 7 21:21:42.182: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 5.423007ms May 7 21:21:44.186: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008725086s May 7 21:21:46.190: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4.012903254s May 7 21:21:48.193: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 6.016180759s May 7 21:21:50.197: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 8.019850528s May 7 21:21:52.201: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 10.02364004s May 7 21:21:54.205: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 12.027738011s May 7 21:21:56.209: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 14.031997644s May 7 21:21:58.214: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 16.036771882s May 7 21:22:00.219: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 18.041535026s May 7 21:22:02.223: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 20.04572987s May 7 21:22:04.227: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 22.050248268s May 7 21:22:06.231: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 24.054168401s May 7 21:22:08.235: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 26.057698699s May 7 21:22:10.239: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 28.061903618s May 7 21:22:12.242: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 30.064861345s May 7 21:22:14.245: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 32.068398484s May 7 21:22:16.250: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 34.073130309s May 7 21:22:18.253: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 36.075817483s May 7 21:22:20.256: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 38.07945399s May 7 21:22:22.260: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 40.083262482s May 7 21:22:24.264: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 42.08660296s May 7 21:22:26.267: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 44.089617215s May 7 21:22:28.270: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 46.093472363s May 7 21:22:30.274: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 48.097177307s May 7 21:22:32.278: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 50.101022078s May 7 21:22:34.282: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 52.104615594s May 7 21:22:36.285: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 54.108416908s May 7 21:22:38.289: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 56.112223822s May 7 21:22:40.293: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 58.116155099s May 7 21:22:42.297: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.119695859s May 7 21:22:44.300: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.123412889s May 7 21:22:46.303: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.126461568s May 7 21:22:48.307: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.130078782s May 7 21:22:50.311: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.134428496s May 7 21:22:52.315: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.138506484s May 7 21:22:54.318: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.141337699s May 7 21:22:56.321: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.143785518s May 7 21:22:58.324: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.146697897s May 7 21:23:00.326: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.149330831s May 7 21:23:02.330: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.152553555s May 7 21:23:04.333: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.156340111s May 7 21:23:06.336: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.159225468s May 7 21:23:08.339: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.161918456s May 7 21:23:10.343: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.165678308s May 7 21:23:12.346: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.168640066s May 7 21:23:14.350: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.172647032s May 7 21:23:16.352: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.175502198s May 7 21:23:18.356: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.179316234s May 7 21:23:20.359: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.182391515s May 7 21:23:22.362: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.185322788s May 7 21:23:24.366: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.18856448s May 7 21:23:26.368: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.191443573s May 7 21:23:28.372: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.195181629s May 7 21:23:30.375: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.19815518s May 7 21:23:32.379: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.201728358s May 7 21:23:34.382: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.205364119s May 7 21:23:36.386: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.208603945s May 7 21:23:38.389: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.211630039s May 7 21:23:40.392: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.215521358s May 7 21:23:42.397: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.220232137s May 7 21:23:44.400: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.22341265s May 7 21:23:46.403: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.226073947s May 7 21:23:48.407: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.229778898s May 7 21:23:50.409: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.232422672s May 7 21:23:52.413: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.235649554s May 7 21:23:54.417: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.240136225s May 7 21:23:56.420: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.243498495s May 7 21:23:58.424: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.24654915s May 7 21:24:00.428: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.250979782s May 7 21:24:02.432: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.254937667s May 7 21:24:04.435: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.25835445s May 7 21:24:06.439: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.261699842s May 7 21:24:08.443: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.265768409s May 7 21:24:10.447: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.269629579s May 7 21:24:12.450: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.273149314s May 7 21:24:14.454: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.277076286s May 7 21:24:16.457: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.280357586s May 7 21:24:18.462: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.284910826s May 7 21:24:20.466: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.28920794s May 7 21:24:22.473: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.295703628s May 7 21:24:24.476: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.299312319s May 7 21:24:26.479: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.302435694s May 7 21:24:28.483: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.305640747s May 7 21:24:30.487: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.3099069s May 7 21:24:32.491: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.314318133s May 7 21:24:34.496: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.319455016s May 7 21:24:36.500: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.322856819s May 7 21:24:38.504: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.327134023s May 7 21:24:40.509: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.331788944s May 7 21:24:42.513: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.336242017s May 7 21:24:44.517: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.340479932s May 7 21:24:46.521: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.344013971s May 7 21:24:48.526: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.348648751s May 7 21:24:50.529: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.351667035s May 7 21:24:52.532: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.355489343s May 7 21:24:54.538: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.361045937s May 7 21:24:56.542: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.364876456s May 7 21:24:58.547: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.369686205s May 7 21:25:00.551: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.373810301s May 7 21:25:02.556: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.378540531s May 7 21:25:04.558: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.381424334s May 7 21:25:06.561: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.38401036s May 7 21:25:08.566: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.38920176s May 7 21:25:10.570: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.393242177s May 7 21:25:12.575: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.397669112s May 7 21:25:14.580: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.402729209s May 7 21:25:16.583: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.405755444s May 7 21:25:18.587: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.40978217s May 7 21:25:20.595: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.417754635s May 7 21:25:22.601: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.424098039s May 7 21:25:24.605: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.427933202s May 7 21:25:26.608: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.4314271s May 7 21:25:28.614: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.436809259s May 7 21:25:30.618: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.441293213s May 7 21:25:32.623: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.446355509s May 7 21:25:34.627: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.449662649s May 7 21:25:36.630: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.453256715s May 7 21:25:38.635: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.458462561s May 7 21:25:40.639: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.462209656s May 7 21:25:42.643: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.465579143s May 7 21:25:44.646: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.468718029s May 7 21:25:46.649: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.472304907s May 7 21:25:48.653: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.476282363s May 7 21:25:50.658: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.48114638s May 7 21:25:52.663: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.485559393s May 7 21:25:54.665: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.488440031s May 7 21:25:56.668: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.491517131s May 7 21:25:58.672: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.494774594s May 7 21:26:00.676: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.498901446s May 7 21:26:02.681: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.504008363s May 7 21:26:04.685: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.507596452s May 7 21:26:06.688: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.511216891s May 7 21:26:08.691: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.513731845s May 7 21:26:10.693: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.516462238s May 7 21:26:12.697: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.520188236s May 7 21:26:14.700: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.523263864s May 7 21:26:16.703: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.525830036s May 7 21:26:18.706: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.528720227s May 7 21:26:20.709: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.532379898s May 7 21:26:22.713: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.535790935s May 7 21:26:24.717: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.54016489s May 7 21:26:26.721: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.543816334s May 7 21:26:28.723: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.546475819s May 7 21:26:30.727: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.549755972s May 7 21:26:32.730: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.553427616s May 7 21:26:34.734: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.556588386s May 7 21:26:36.736: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.559214303s May 7 21:26:38.741: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.564473693s May 7 21:26:40.745: INFO: Pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.567961605s May 7 21:26:42.755: INFO: Failed to get logs from node "node2" pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca" container "secret-env-test": the server rejected our request for an unknown reason (get pods pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca) STEP: delete the pod May 7 21:26:42.760: INFO: Waiting for pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca to disappear May 7 21:26:42.763: INFO: Pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca still exists May 7 21:26:44.765: INFO: Waiting for pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca to disappear May 7 21:26:44.767: INFO: Pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca still exists May 7 21:26:46.763: INFO: Waiting for pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca to disappear May 7 21:26:46.765: INFO: Pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca still exists May 7 21:26:48.763: INFO: Waiting for pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca to disappear May 7 21:26:48.766: INFO: Pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca still exists May 7 21:26:50.763: INFO: Waiting for pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca to disappear May 7 21:26:50.767: INFO: Pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca still exists May 7 21:26:52.763: INFO: Waiting for pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca to disappear May 7 21:26:52.766: INFO: Pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca still exists May 7 21:26:54.764: INFO: Waiting for pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca to disappear May 7 21:26:54.767: INFO: Pod pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca no longer exists May 7 21:26:54.768: FAIL: Unexpected error: <*errors.errorString | 0xc004bf7560>: { s: "expected pod \"pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca\" success: Gave up after waiting 5m0s for pod \"pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca\" to be \"Succeeded or Failed\"", } expected pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca" success: Gave up after waiting 5m0s for pod "pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0001c78c0, 0x4c097bc, 0xf, 0xc004e45800, 0x0, 0xc000669168, 0x1, 0x1, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func27.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/secrets.go:83 +0x91a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003541380, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "secrets-558". STEP: Found 9 events. May 7 21:26:54.773: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca: { } Scheduled: Successfully assigned secrets-558/pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca to node2 May 7 21:26:54.773: INFO: At 2021-05-07 21:21:43 +0000 UTC - event for pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca: {multus } AddedInterface: Add eth0 [10.244.4.89/24] May 7 21:26:54.773: INFO: At 2021-05-07 21:21:43 +0000 UTC - event for pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 7 21:26:54.773: INFO: At 2021-05-07 21:21:44 +0000 UTC - event for pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:26:54.773: INFO: At 2021-05-07 21:21:44 +0000 UTC - event for pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca: {kubelet node2} Failed: Error: ErrImagePull May 7 21:26:54.773: INFO: At 2021-05-07 21:21:45 +0000 UTC - event for pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 7 21:26:54.773: INFO: At 2021-05-07 21:21:48 +0000 UTC - event for pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca: {multus } AddedInterface: Add eth0 [10.244.4.90/24] May 7 21:26:54.773: INFO: At 2021-05-07 21:21:49 +0000 UTC - event for pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 7 21:26:54.773: INFO: At 2021-05-07 21:21:49 +0000 UTC - event for pod-secrets-dfee4a23-4b5e-41fd-8a5c-83a92b2a0dca: {kubelet node2} Failed: Error: ImagePullBackOff May 7 21:26:54.776: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:26:54.776: INFO: May 7 21:26:54.780: INFO: Logging node info for node master1 May 7 21:26:54.783: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 29375 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:44 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:44 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:44 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:26:44 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:26:54.783: INFO: Logging kubelet events for node master1 May 7 21:26:54.785: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:26:54.807: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.808: INFO: Container kube-multus ready: true, restart count 1 May 7 21:26:54.808: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:26:54.808: INFO: Container docker-registry ready: true, restart count 0 May 7 21:26:54.808: INFO: Container nginx ready: true, restart count 0 May 7 21:26:54.808: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:26:54.808: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:26:54.808: INFO: Container prometheus-operator ready: true, restart count 0 May 7 21:26:54.808: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.808: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:26:54.808: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.808: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:26:54.808: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.808: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:26:54.808: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:26:54.808: INFO: Init container install-cni ready: true, restart count 0 May 7 21:26:54.808: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:26:54.808: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.808: INFO: Container coredns ready: true, restart count 2 May 7 21:26:54.808: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.808: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:26:54.808: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:26:54.808: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:26:54.808: INFO: Container node-exporter ready: true, restart count 0 May 7 21:26:54.808: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.808: INFO: Container kube-apiserver ready: true, restart count 0 W0507 21:26:54.819428 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:26:54.851: INFO: Latency metrics for node master1 May 7 21:26:54.851: INFO: Logging node info for node master2 May 7 21:26:54.853: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 29533 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:51 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:51 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:51 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:26:51 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:26:54.854: INFO: Logging kubelet events for node master2 May 7 21:26:54.856: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:26:54.865: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.865: INFO: Container autoscaler ready: true, restart count 2 May 7 21:26:54.865: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:26:54.865: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:26:54.865: INFO: Container node-exporter ready: true, restart count 0 May 7 21:26:54.865: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.865: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:26:54.865: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.865: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:26:54.865: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.865: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:26:54.865: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.865: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:26:54.865: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:26:54.865: INFO: Init container install-cni ready: true, restart count 0 May 7 21:26:54.865: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:26:54.865: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.865: INFO: Container kube-multus ready: true, restart count 1 W0507 21:26:54.876614 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:26:54.900: INFO: Latency metrics for node master2 May 7 21:26:54.900: INFO: Logging node info for node master3 May 7 21:26:54.902: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 29532 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:51 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:51 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:51 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:26:51 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:26:54.903: INFO: Logging kubelet events for node master3 May 7 21:26:54.905: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:26:54.912: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.912: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:26:54.912: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.912: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:26:54.912: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.912: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:26:54.912: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:26:54.912: INFO: Init container install-cni ready: true, restart count 1 May 7 21:26:54.912: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:26:54.912: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.912: INFO: Container kube-multus ready: true, restart count 1 May 7 21:26:54.912: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.912: INFO: Container coredns ready: true, restart count 2 May 7 21:26:54.912: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:26:54.912: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:26:54.912: INFO: Container node-exporter ready: true, restart count 0 May 7 21:26:54.912: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.912: INFO: Container kube-apiserver ready: true, restart count 0 W0507 21:26:54.927233 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:26:54.957: INFO: Latency metrics for node master3 May 7 21:26:54.957: INFO: Logging node info for node node1 May 7 21:26:54.960: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 29482 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:50 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:50 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:50 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:26:50 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:26:54.961: INFO: Logging kubelet events for node node1 May 7 21:26:54.963: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:26:54.978: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:26:54.978: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:26:54.978: INFO: Container discover ready: false, restart count 0 May 7 21:26:54.978: INFO: Container init ready: false, restart count 0 May 7 21:26:54.978: INFO: Container install ready: false, restart count 0 May 7 21:26:54.978: INFO: pod-exec-websocket-9f70020e-ca5a-44f7-b731-a9e2e7108468 started at 2021-05-07 21:23:13 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container main ready: false, restart count 0 May 7 21:26:54.978: INFO: pod-service-account-6d58e719-76df-4411-8427-77c9cc31b62b started at 2021-05-07 21:21:51 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container test ready: false, restart count 0 May 7 21:26:54.978: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:26:54.978: INFO: Container nodereport ready: true, restart count 0 May 7 21:26:54.978: INFO: Container reconcile ready: true, restart count 0 May 7 21:26:54.978: INFO: fail-once-local-xq6h7 started at 2021-05-07 21:26:12 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container c ready: false, restart count 0 May 7 21:26:54.978: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container kube-multus ready: true, restart count 1 May 7 21:26:54.978: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:26:54.978: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:26:54.978: INFO: Container grafana ready: true, restart count 0 May 7 21:26:54.978: INFO: Container prometheus ready: true, restart count 1 May 7 21:26:54.978: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:26:54.978: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 7 21:26:54.978: INFO: fail-once-local-5m46c started at 2021-05-07 21:26:12 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container c ready: false, restart count 0 May 7 21:26:54.978: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:26:54.978: INFO: Init container install-cni ready: true, restart count 2 May 7 21:26:54.978: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:26:54.978: INFO: simpletest.deployment-7f7555f8bc-xhgqj started at 2021-05-07 21:26:45 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container nginx ready: false, restart count 0 May 7 21:26:54.978: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:26:54.978: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:26:54.978: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:26:54.978: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:26:54.978: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:26:54.978: INFO: Container node-exporter ready: true, restart count 0 May 7 21:26:54.978: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:26:54.978: INFO: Container collectd ready: true, restart count 0 May 7 21:26:54.978: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:26:54.978: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:26:54.978: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:26:54.978: INFO: client-envvars-6eebb421-3a32-419b-b48d-220c4773da42 started at 2021-05-07 21:25:48 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container env3cont ready: false, restart count 0 May 7 21:26:54.978: INFO: sample-webhook-deployment-cbccbf6bb-t6fd2 started at 2021-05-07 21:26:46 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container sample-webhook ready: true, restart count 0 May 7 21:26:54.978: INFO: server-envvars-e2816f49-41f1-428a-9e96-293b2452238b started at 2021-05-07 21:20:35 +0000 UTC (0+1 container statuses recorded) May 7 21:26:54.978: INFO: Container srv ready: true, restart count 0 W0507 21:26:54.991577 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:26:55.022: INFO: Latency metrics for node node1 May 7 21:26:55.022: INFO: Logging node info for node node2 May 7 21:26:55.025: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 29454 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:48 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:48 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:26:48 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:26:48 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:26:55.025: INFO: Logging kubelet events for node node2 May 7 21:26:55.028: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:26:55.041: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.041: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:26:55.041: INFO: test-rollover-controller-9qhvg started at 2021-05-07 21:25:56 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.041: INFO: Container httpd ready: false, restart count 0 May 7 21:26:55.041: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.041: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:26:55.041: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:26:55.041: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:26:55.041: INFO: Container node-exporter ready: true, restart count 0 May 7 21:26:55.041: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:26:55.041: INFO: Init container install-cni ready: true, restart count 2 May 7 21:26:55.041: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:26:55.042: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.042: INFO: Container kube-multus ready: true, restart count 1 May 7 21:26:55.042: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:26:55.042: INFO: Container tas-controller ready: true, restart count 0 May 7 21:26:55.042: INFO: Container tas-extender ready: true, restart count 0 May 7 21:26:55.042: INFO: var-expansion-f8e66cd5-ac10-4746-a81c-465a4b6408ff started at 2021-05-07 21:26:00 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.042: INFO: Container dapi-container ready: false, restart count 0 May 7 21:26:55.042: INFO: simpletest.deployment-7f7555f8bc-v4wlq started at 2021-05-07 21:26:45 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.042: INFO: Container nginx ready: false, restart count 0 May 7 21:26:55.042: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.042: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:26:55.042: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:26:55.042: INFO: Container discover ready: false, restart count 0 May 7 21:26:55.042: INFO: Container init ready: false, restart count 0 May 7 21:26:55.042: INFO: Container install ready: false, restart count 0 May 7 21:26:55.042: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:26:55.042: INFO: Container nodereport ready: true, restart count 0 May 7 21:26:55.042: INFO: Container reconcile ready: true, restart count 0 May 7 21:26:55.042: INFO: var-expansion-57d7e0be-4edf-4c50-ae38-6263f6e1c41a started at 2021-05-07 21:26:51 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.042: INFO: Container dapi-container ready: false, restart count 0 May 7 21:26:55.042: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.042: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:26:55.042: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:26:55.042: INFO: Container collectd ready: true, restart count 0 May 7 21:26:55.042: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:26:55.042: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:26:55.042: INFO: downward-api-f0dc82d8-62a1-4f8e-94bb-e4c2ec7730b4 started at 2021-05-07 21:26:15 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.042: INFO: Container dapi-container ready: false, restart count 0 May 7 21:26:55.042: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.042: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:26:55.042: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:26:55.042: INFO: Container kube-sriovdp ready: true, restart count 0 W0507 21:26:55.055322 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:26:55.083: INFO: Latency metrics for node node2 May 7 21:26:55.083: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-558" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:38:25.741: Failed getting pod e2e-test-httpd-pod: Timeout while waiting for pods with labels "run=e2e-test-httpd-pod" to be running /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1567 [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:28:25.359: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [BeforeEach] Kubectl replace /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1546 [It] should update a single-container pod's image [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: running the image docker.io/library/httpd:2.4.38-alpine May 7 21:28:25.379: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8342 run e2e-test-httpd-pod --image=docker.io/library/httpd:2.4.38-alpine --labels=run=e2e-test-httpd-pod' May 7 21:28:25.554: INFO: stderr: "" May 7 21:28:25.554: INFO: stdout: "pod/e2e-test-httpd-pod created\n" STEP: verifying the pod e2e-test-httpd-pod is running May 7 21:38:25.741: FAIL: Failed getting pod e2e-test-httpd-pod: Timeout while waiting for pods with labels "run=e2e-test-httpd-pod" to be running Full Stack Trace k8s.io/kubernetes/test/e2e/kubectl.glob..func1.27.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1567 +0xb6c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003541380, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] Kubectl replace /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1550 May 7 21:38:25.742: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8342 delete pods e2e-test-httpd-pod' May 7 21:38:27.944: INFO: stderr: "" May 7 21:38:27.944: INFO: stdout: "pod \"e2e-test-httpd-pod\" deleted\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "kubectl-8342". STEP: Found 9 events. May 7 21:38:27.947: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for e2e-test-httpd-pod: { } Scheduled: Successfully assigned kubectl-8342/e2e-test-httpd-pod to node1 May 7 21:38:27.948: INFO: At 2021-05-07 21:28:27 +0000 UTC - event for e2e-test-httpd-pod: {multus } AddedInterface: Add eth0 [10.244.3.111/24] May 7 21:38:27.948: INFO: At 2021-05-07 21:28:27 +0000 UTC - event for e2e-test-httpd-pod: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:38:27.948: INFO: At 2021-05-07 21:28:28 +0000 UTC - event for e2e-test-httpd-pod: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:38:27.948: INFO: At 2021-05-07 21:28:28 +0000 UTC - event for e2e-test-httpd-pod: {kubelet node1} Failed: Error: ErrImagePull May 7 21:38:27.948: INFO: At 2021-05-07 21:28:28 +0000 UTC - event for e2e-test-httpd-pod: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 7 21:38:27.948: INFO: At 2021-05-07 21:28:29 +0000 UTC - event for e2e-test-httpd-pod: {multus } AddedInterface: Add eth0 [10.244.3.112/24] May 7 21:38:27.948: INFO: At 2021-05-07 21:28:29 +0000 UTC - event for e2e-test-httpd-pod: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 7 21:38:27.948: INFO: At 2021-05-07 21:28:29 +0000 UTC - event for e2e-test-httpd-pod: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:38:27.951: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:38:27.951: INFO: May 7 21:38:27.956: INFO: Logging node info for node master1 May 7 21:38:27.959: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 35701 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:27 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:27 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:27 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:38:27 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:38:27.959: INFO: Logging kubelet events for node master1 May 7 21:38:27.961: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:38:27.971: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:38:27.971: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:38:27.971: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:38:27.971: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:27.971: INFO: Container node-exporter ready: true, restart count 0 May 7 21:38:27.971: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:38:27.971: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:38:27.971: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:38:27.971: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:38:27.971: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:38:27.971: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:38:27.971: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:38:27.971: INFO: Init container install-cni ready: true, restart count 0 May 7 21:38:27.971: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:38:27.971: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:38:27.971: INFO: Container coredns ready: true, restart count 2 May 7 21:38:27.971: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:27.971: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:38:27.971: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:38:27.971: INFO: Container kube-multus ready: true, restart count 1 May 7 21:38:27.971: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:38:27.971: INFO: Container docker-registry ready: true, restart count 0 May 7 21:38:27.971: INFO: Container nginx ready: true, restart count 0 May 7 21:38:27.971: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:38:27.971: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:27.971: INFO: Container prometheus-operator ready: true, restart count 0 W0507 21:38:27.985069 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:38:28.017: INFO: Latency metrics for node master1 May 7 21:38:28.017: INFO: Logging node info for node master2 May 7 21:38:28.019: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 35665 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:38:28.020: INFO: Logging kubelet events for node master2 May 7 21:38:28.022: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:38:28.028: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.028: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:38:28.028: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:38:28.028: INFO: Init container install-cni ready: true, restart count 0 May 7 21:38:28.028: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:38:28.028: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.028: INFO: Container kube-multus ready: true, restart count 1 May 7 21:38:28.028: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.028: INFO: Container autoscaler ready: true, restart count 2 May 7 21:38:28.028: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:38:28.028: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:28.028: INFO: Container node-exporter ready: true, restart count 0 May 7 21:38:28.028: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.029: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:38:28.029: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.029: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:38:28.029: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.029: INFO: Container kube-scheduler ready: true, restart count 2 W0507 21:38:28.042186 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:38:28.066: INFO: Latency metrics for node master2 May 7 21:38:28.066: INFO: Logging node info for node master3 May 7 21:38:28.069: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 35664 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:38:28.069: INFO: Logging kubelet events for node master3 May 7 21:38:28.071: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:38:28.080: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:38:28.080: INFO: Init container install-cni ready: true, restart count 1 May 7 21:38:28.080: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:38:28.080: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.080: INFO: Container kube-multus ready: true, restart count 1 May 7 21:38:28.080: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.080: INFO: Container coredns ready: true, restart count 2 May 7 21:38:28.080: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:38:28.080: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:28.080: INFO: Container node-exporter ready: true, restart count 0 May 7 21:38:28.080: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.080: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:38:28.080: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.080: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:38:28.080: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.080: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:38:28.080: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.080: INFO: Container kube-proxy ready: true, restart count 1 W0507 21:38:28.092611 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:38:28.120: INFO: Latency metrics for node master3 May 7 21:38:28.120: INFO: Logging node info for node node1 May 7 21:38:28.123: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 35666 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:38:24 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:38:28.123: INFO: Logging kubelet events for node node1 May 7 21:38:28.126: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:38:28.140: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:38:28.140: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:28.140: INFO: Container node-exporter ready: true, restart count 0 May 7 21:38:28.140: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:38:28.140: INFO: Container collectd ready: true, restart count 0 May 7 21:38:28.140: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:38:28.140: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:38:28.140: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.140: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:38:28.140: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.140: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:38:28.140: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.140: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:38:28.140: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.140: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:38:28.140: INFO: busybox-readonly-false-485dae77-09e9-489c-93b3-0d85db80d39d started at 2021-05-07 21:37:35 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.140: INFO: Container busybox-readonly-false-485dae77-09e9-489c-93b3-0d85db80d39d ready: false, restart count 0 May 7 21:38:28.140: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.140: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:38:28.140: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:38:28.140: INFO: Container discover ready: false, restart count 0 May 7 21:38:28.140: INFO: Container init ready: false, restart count 0 May 7 21:38:28.140: INFO: Container install ready: false, restart count 0 May 7 21:38:28.140: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:38:28.140: INFO: Container nodereport ready: true, restart count 0 May 7 21:38:28.140: INFO: Container reconcile ready: true, restart count 0 May 7 21:38:28.140: INFO: fail-once-local-xq6h7 started at 2021-05-07 21:26:12 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.140: INFO: Container c ready: false, restart count 0 May 7 21:38:28.140: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.140: INFO: Container kube-multus ready: true, restart count 1 May 7 21:38:28.140: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:38:28.140: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:38:28.140: INFO: Container grafana ready: true, restart count 0 May 7 21:38:28.140: INFO: Container prometheus ready: true, restart count 1 May 7 21:38:28.140: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:38:28.140: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 7 21:38:28.140: INFO: fail-once-local-5m46c started at 2021-05-07 21:26:12 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.140: INFO: Container c ready: false, restart count 0 May 7 21:38:28.140: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:38:28.140: INFO: Init container install-cni ready: true, restart count 2 May 7 21:38:28.140: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:38:28.140: INFO: test-cleanup-controller-jlp8m started at 2021-05-07 21:36:34 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.140: INFO: Container httpd ready: false, restart count 0 W0507 21:38:28.154642 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:38:28.196: INFO: Latency metrics for node node1 May 7 21:38:28.196: INFO: Logging node info for node node2 May 7 21:38:28.199: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 35663 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:23 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:23 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:38:23 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:38:23 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:38:28.200: INFO: Logging kubelet events for node node2 May 7 21:38:28.202: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:38:28.214: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.214: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:38:28.215: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:38:28.215: INFO: Container collectd ready: true, restart count 0 May 7 21:38:28.215: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:38:28.215: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:38:28.215: INFO: var-expansion-2a103680-c8c4-41d0-afa0-0bd8859de82a started at 2021-05-07 21:38:25 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container dapi-container ready: false, restart count 0 May 7 21:38:28.215: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:38:28.215: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:38:28.215: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:38:28.215: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:38:28.215: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:38:28.215: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:38:28.215: INFO: Container node-exporter ready: true, restart count 0 May 7 21:38:28.215: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:38:28.215: INFO: Init container install-cni ready: true, restart count 2 May 7 21:38:28.215: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:38:28.215: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container kube-multus ready: true, restart count 1 May 7 21:38:28.215: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:38:28.215: INFO: Container tas-controller ready: true, restart count 0 May 7 21:38:28.215: INFO: Container tas-extender ready: true, restart count 0 May 7 21:38:28.215: INFO: downward-api-a038e9eb-c345-45ac-bdd3-4e5d7670bb4d started at 2021-05-07 21:37:27 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container dapi-container ready: false, restart count 0 May 7 21:38:28.215: INFO: ss2-0 started at 2021-05-07 21:31:12 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container webserver ready: false, restart count 0 May 7 21:38:28.215: INFO: projected-volume-918949e6-9fc5-483d-9df9-714ed1b08e8c started at 2021-05-07 21:33:40 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container projected-all-volume-test ready: false, restart count 0 May 7 21:38:28.215: INFO: downward-api-8f05d9d9-cf80-47e6-b1f8-1bcd5bf8908f started at 2021-05-07 21:36:16 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container dapi-container ready: false, restart count 0 May 7 21:38:28.215: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:38:28.215: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:38:28.215: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:38:28.215: INFO: Container discover ready: false, restart count 0 May 7 21:38:28.215: INFO: Container init ready: false, restart count 0 May 7 21:38:28.215: INFO: Container install ready: false, restart count 0 May 7 21:38:28.215: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:38:28.215: INFO: Container nodereport ready: true, restart count 0 May 7 21:38:28.215: INFO: Container reconcile ready: true, restart count 0 W0507 21:38:28.229210 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:38:28.273: INFO: Latency metrics for node node2 May 7 21:38:28.273: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-8342" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:44:07.195: Unexpected error: <*errors.errorString | 0xc0044f9060>: { s: "expected pod \"pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4\" success: Gave up after waiting 5m0s for pod \"pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4\" to be \"Succeeded or Failed\"", } expected pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4" success: Gave up after waiting 5m0s for pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:38:56.568: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable via environment variable [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap configmap-4089/configmap-test-b5b697e1-bba1-4032-905e-c92c58811b26 STEP: Creating a pod to test consume configMaps May 7 21:38:56.610: INFO: Waiting up to 5m0s for pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4" in namespace "configmap-4089" to be "Succeeded or Failed" May 7 21:38:56.615: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.714737ms May 7 21:38:58.619: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008709803s May 7 21:39:00.622: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.011907025s May 7 21:39:02.628: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.017254238s May 7 21:39:04.631: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.020033239s May 7 21:39:06.637: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.026026899s May 7 21:39:08.641: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 12.030765249s May 7 21:39:10.644: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 14.033822518s May 7 21:39:12.648: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 16.037168528s May 7 21:39:14.651: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 18.040314548s May 7 21:39:16.654: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 20.043394675s May 7 21:39:18.657: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 22.046417069s May 7 21:39:20.660: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 24.049340317s May 7 21:39:22.663: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 26.052875512s May 7 21:39:24.667: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 28.056980514s May 7 21:39:26.671: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 30.06083733s May 7 21:39:28.675: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 32.064654358s May 7 21:39:30.678: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 34.067868455s May 7 21:39:32.682: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 36.0716193s May 7 21:39:34.686: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 38.074987468s May 7 21:39:36.689: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 40.078077118s May 7 21:39:38.692: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 42.081949656s May 7 21:39:40.696: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 44.085460302s May 7 21:39:42.700: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 46.08919687s May 7 21:39:44.704: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 48.09397306s May 7 21:39:46.709: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 50.098306545s May 7 21:39:48.714: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 52.103035146s May 7 21:39:50.717: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 54.106357743s May 7 21:39:52.720: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 56.109782205s May 7 21:39:54.723: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 58.112818451s May 7 21:39:56.728: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.117189517s May 7 21:39:58.734: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.123127833s May 7 21:40:00.738: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.127836495s May 7 21:40:02.743: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.13286754s May 7 21:40:04.750: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.139589089s May 7 21:40:06.754: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.143781642s May 7 21:40:08.759: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.148811791s May 7 21:40:10.764: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.153049331s May 7 21:40:12.769: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.158500518s May 7 21:40:14.772: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.161800464s May 7 21:40:16.775: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.164787633s May 7 21:40:18.779: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.16889391s May 7 21:40:20.782: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.171455023s May 7 21:40:22.786: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.175409923s May 7 21:40:24.789: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.178655784s May 7 21:40:26.794: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.18348792s May 7 21:40:28.797: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.186827035s May 7 21:40:30.803: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.19271834s May 7 21:40:32.808: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.197646134s May 7 21:40:34.812: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.201895918s May 7 21:40:36.816: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.20504838s May 7 21:40:38.819: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.208276073s May 7 21:40:40.825: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.214146417s May 7 21:40:42.829: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.218362504s May 7 21:40:44.834: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.223277188s May 7 21:40:46.838: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.227693441s May 7 21:40:48.846: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.235886327s May 7 21:40:50.850: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.239280133s May 7 21:40:52.853: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.242798071s May 7 21:40:54.858: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.247057538s May 7 21:40:56.861: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.250047265s May 7 21:40:58.864: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.253348911s May 7 21:41:00.867: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.256887569s May 7 21:41:02.871: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.260476154s May 7 21:41:04.875: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.264002959s May 7 21:41:06.877: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.266904768s May 7 21:41:08.880: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.269592662s May 7 21:41:10.883: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.272726477s May 7 21:41:12.886: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.275707286s May 7 21:41:14.892: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.281852452s May 7 21:41:16.898: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.287257136s May 7 21:41:18.902: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.290997949s May 7 21:41:20.908: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.29791835s May 7 21:41:22.912: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.301486016s May 7 21:41:24.917: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.306938585s May 7 21:41:26.921: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.310081437s May 7 21:41:28.925: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.314010463s May 7 21:41:30.928: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.31708013s May 7 21:41:32.931: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.320270363s May 7 21:41:34.936: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.325650155s May 7 21:41:36.940: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.32927499s May 7 21:41:38.945: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.334118038s May 7 21:41:40.947: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.336788923s May 7 21:41:42.950: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.33921424s May 7 21:41:44.955: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.344004436s May 7 21:41:46.958: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.347176218s May 7 21:41:48.963: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.352772153s May 7 21:41:50.967: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.35696719s May 7 21:41:52.970: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.35993105s May 7 21:41:54.974: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.363064181s May 7 21:41:56.978: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.367053571s May 7 21:41:58.981: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.370801725s May 7 21:42:00.985: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.374889492s May 7 21:42:02.988: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.377714566s May 7 21:42:04.993: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.382157318s May 7 21:42:06.996: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.385206896s May 7 21:42:08.999: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.388382807s May 7 21:42:11.003: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.392249309s May 7 21:42:13.005: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.394901023s May 7 21:42:15.008: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.397936698s May 7 21:42:17.011: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.400807332s May 7 21:42:19.014: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.403748854s May 7 21:42:21.017: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.406973583s May 7 21:42:23.021: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.410918956s May 7 21:42:25.024: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.413394216s May 7 21:42:27.027: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.416646751s May 7 21:42:29.031: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.420366354s May 7 21:42:31.035: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.424180569s May 7 21:42:33.038: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.427917748s May 7 21:42:35.042: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.431125611s May 7 21:42:37.045: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.434446889s May 7 21:42:39.048: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.437389196s May 7 21:42:41.051: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.440158504s May 7 21:42:43.054: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.443707495s May 7 21:42:45.057: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.446486087s May 7 21:42:47.060: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.449541444s May 7 21:42:49.064: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.453912747s May 7 21:42:51.068: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.457244047s May 7 21:42:53.071: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.46049822s May 7 21:42:55.075: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.463993186s May 7 21:42:57.078: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.467970071s May 7 21:42:59.081: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.470758224s May 7 21:43:01.084: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.473873372s May 7 21:43:03.087: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.476481653s May 7 21:43:05.090: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.479584689s May 7 21:43:07.093: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.48259742s May 7 21:43:09.096: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.484999342s May 7 21:43:11.099: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.488074985s May 7 21:43:13.102: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.491806814s May 7 21:43:15.106: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.495956579s May 7 21:43:17.109: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.498299969s May 7 21:43:19.112: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.501409533s May 7 21:43:21.116: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.505980182s May 7 21:43:23.120: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.509284579s May 7 21:43:25.122: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.511925218s May 7 21:43:27.125: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.514934657s May 7 21:43:29.129: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.518959026s May 7 21:43:31.136: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.525115786s May 7 21:43:33.139: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.528322169s May 7 21:43:35.142: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.531634603s May 7 21:43:37.145: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.534719235s May 7 21:43:39.149: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.538213196s May 7 21:43:41.151: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.540799525s May 7 21:43:43.155: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.544657867s May 7 21:43:45.159: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.548231269s May 7 21:43:47.163: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.552667899s May 7 21:43:49.166: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.555623932s May 7 21:43:51.169: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.558483433s May 7 21:43:53.172: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.561852324s May 7 21:43:55.176: INFO: Pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.56564126s May 7 21:43:57.185: INFO: Failed to get logs from node "node1" pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4" container "env-test": the server rejected our request for an unknown reason (get pods pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4) STEP: delete the pod May 7 21:43:57.189: INFO: Waiting for pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 to disappear May 7 21:43:57.191: INFO: Pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 still exists May 7 21:43:59.192: INFO: Waiting for pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 to disappear May 7 21:43:59.195: INFO: Pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 still exists May 7 21:44:01.192: INFO: Waiting for pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 to disappear May 7 21:44:01.195: INFO: Pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 still exists May 7 21:44:03.192: INFO: Waiting for pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 to disappear May 7 21:44:03.196: INFO: Pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 still exists May 7 21:44:05.192: INFO: Waiting for pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 to disappear May 7 21:44:05.195: INFO: Pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 still exists May 7 21:44:07.192: INFO: Waiting for pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 to disappear May 7 21:44:07.194: INFO: Pod pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 no longer exists May 7 21:44:07.195: FAIL: Unexpected error: <*errors.errorString | 0xc0044f9060>: { s: "expected pod \"pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4\" success: Gave up after waiting 5m0s for pod \"pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4\" to be \"Succeeded or Failed\"", } expected pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4" success: Gave up after waiting 5m0s for pod "pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00056fb80, 0x4c18c6e, 0x12, 0xc009f80400, 0x0, 0xc00878f158, 0x1, 0x1, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func1.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap.go:80 +0x8a5 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003541380, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "configmap-4089". STEP: Found 7 events. May 7 21:44:07.200: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4: { } Scheduled: Successfully assigned configmap-4089/pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4 to node1 May 7 21:44:07.200: INFO: At 2021-05-07 21:38:58 +0000 UTC - event for pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4: {multus } AddedInterface: Add eth0 [10.244.3.148/24] May 7 21:44:07.200: INFO: At 2021-05-07 21:38:58 +0000 UTC - event for pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 7 21:44:07.200: INFO: At 2021-05-07 21:38:59 +0000 UTC - event for pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:44:07.200: INFO: At 2021-05-07 21:38:59 +0000 UTC - event for pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4: {kubelet node1} Failed: Error: ErrImagePull May 7 21:44:07.200: INFO: At 2021-05-07 21:38:59 +0000 UTC - event for pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 7 21:44:07.200: INFO: At 2021-05-07 21:38:59 +0000 UTC - event for pod-configmaps-2e4b8dc1-7c96-4b2b-96b1-3bf74b69ebc4: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:44:07.202: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:44:07.202: INFO: May 7 21:44:07.207: INFO: Logging node info for node master1 May 7 21:44:07.210: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 38615 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:43:58 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:43:58 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:43:58 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:43:58 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:44:07.210: INFO: Logging kubelet events for node master1 May 7 21:44:07.212: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:44:07.222: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:44:07.222: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:44:07.222: INFO: Container node-exporter ready: true, restart count 0 May 7 21:44:07.222: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.222: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:44:07.222: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.222: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:44:07.222: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.222: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:44:07.222: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:44:07.222: INFO: Init container install-cni ready: true, restart count 0 May 7 21:44:07.222: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:44:07.222: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.222: INFO: Container coredns ready: true, restart count 2 May 7 21:44:07.222: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.222: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:44:07.222: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.222: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:44:07.222: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.222: INFO: Container kube-multus ready: true, restart count 1 May 7 21:44:07.222: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:44:07.222: INFO: Container docker-registry ready: true, restart count 0 May 7 21:44:07.222: INFO: Container nginx ready: true, restart count 0 May 7 21:44:07.222: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:44:07.222: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:44:07.222: INFO: Container prometheus-operator ready: true, restart count 0 W0507 21:44:07.236204 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:44:07.260: INFO: Latency metrics for node master1 May 7 21:44:07.260: INFO: Logging node info for node master2 May 7 21:44:07.262: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 38694 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:44:07.263: INFO: Logging kubelet events for node master2 May 7 21:44:07.264: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:44:07.273: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:44:07.273: INFO: Init container install-cni ready: true, restart count 0 May 7 21:44:07.273: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:44:07.273: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.273: INFO: Container kube-multus ready: true, restart count 1 May 7 21:44:07.273: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.273: INFO: Container autoscaler ready: true, restart count 2 May 7 21:44:07.273: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:44:07.273: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:44:07.273: INFO: Container node-exporter ready: true, restart count 0 May 7 21:44:07.273: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.273: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:44:07.273: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.273: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:44:07.273: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.273: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:44:07.273: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.273: INFO: Container kube-proxy ready: true, restart count 1 W0507 21:44:07.287415 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:44:07.315: INFO: Latency metrics for node master2 May 7 21:44:07.315: INFO: Logging node info for node master3 May 7 21:44:07.318: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 38692 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:44:07.318: INFO: Logging kubelet events for node master3 May 7 21:44:07.320: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:44:07.329: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.329: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:44:07.329: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:44:07.329: INFO: Init container install-cni ready: true, restart count 1 May 7 21:44:07.329: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:44:07.329: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.329: INFO: Container kube-multus ready: true, restart count 1 May 7 21:44:07.329: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.329: INFO: Container coredns ready: true, restart count 2 May 7 21:44:07.329: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:44:07.329: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:44:07.329: INFO: Container node-exporter ready: true, restart count 0 May 7 21:44:07.329: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.329: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:44:07.329: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.329: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:44:07.329: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.329: INFO: Container kube-scheduler ready: true, restart count 2 W0507 21:44:07.344058 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:44:07.372: INFO: Latency metrics for node master3 May 7 21:44:07.372: INFO: Logging node info for node node1 May 7 21:44:07.375: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 38700 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:07 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:07 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:07 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:44:07 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:44:07.376: INFO: Logging kubelet events for node node1 May 7 21:44:07.378: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:44:07.392: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container kube-multus ready: true, restart count 1 May 7 21:44:07.392: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:44:07.392: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:44:07.392: INFO: Container grafana ready: true, restart count 0 May 7 21:44:07.392: INFO: Container prometheus ready: true, restart count 1 May 7 21:44:07.392: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:44:07.392: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 7 21:44:07.392: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:44:07.392: INFO: Init container install-cni ready: true, restart count 2 May 7 21:44:07.392: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:44:07.392: INFO: busybox-85b0aa1a-3afd-439c-8465-4cddd9f1b7f7 started at 2021-05-07 21:42:23 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container busybox ready: false, restart count 0 May 7 21:44:07.392: INFO: affinity-nodeport-kgc68 started at 2021-05-07 21:43:23 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container affinity-nodeport ready: true, restart count 0 May 7 21:44:07.392: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:44:07.392: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:44:07.392: INFO: Container node-exporter ready: true, restart count 0 May 7 21:44:07.392: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:44:07.392: INFO: Container collectd ready: true, restart count 0 May 7 21:44:07.392: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:44:07.392: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:44:07.392: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:44:07.392: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:44:07.392: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:44:07.392: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:44:07.392: INFO: update-demo-nautilus-c9v6w started at 2021-05-07 21:43:56 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container update-demo ready: true, restart count 0 May 7 21:44:07.392: INFO: test-webserver-96b20153-5d7c-452b-92f4-807dd1d2c02e started at 2021-05-07 21:44:04 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container test-webserver ready: false, restart count 0 May 7 21:44:07.392: INFO: busybox-readonly-fs741cab0a-f193-40e3-b10c-f3e81981aa38 started at 2021-05-07 21:40:26 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container busybox-readonly-fs741cab0a-f193-40e3-b10c-f3e81981aa38 ready: false, restart count 0 May 7 21:44:07.392: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.392: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:44:07.392: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:44:07.392: INFO: Container discover ready: false, restart count 0 May 7 21:44:07.392: INFO: Container init ready: false, restart count 0 May 7 21:44:07.392: INFO: Container install ready: false, restart count 0 May 7 21:44:07.392: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:44:07.392: INFO: Container nodereport ready: true, restart count 0 May 7 21:44:07.392: INFO: Container reconcile ready: true, restart count 0 W0507 21:44:07.403930 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:44:07.447: INFO: Latency metrics for node node1 May 7 21:44:07.447: INFO: Logging node info for node node2 May 7 21:44:07.450: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 38695 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:44:05 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:44:07.451: INFO: Logging kubelet events for node node2 May 7 21:44:07.452: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:44:07.467: INFO: ss-0 started at 2021-05-07 21:41:12 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container webserver ready: false, restart count 0 May 7 21:44:07.467: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:44:07.467: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:44:07.467: INFO: Container discover ready: false, restart count 0 May 7 21:44:07.467: INFO: Container init ready: false, restart count 0 May 7 21:44:07.467: INFO: Container install ready: false, restart count 0 May 7 21:44:07.467: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:44:07.467: INFO: Container nodereport ready: true, restart count 0 May 7 21:44:07.467: INFO: Container reconcile ready: true, restart count 0 May 7 21:44:07.467: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:44:07.467: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:44:07.467: INFO: Container collectd ready: true, restart count 0 May 7 21:44:07.467: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:44:07.467: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:44:07.467: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:44:07.467: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:44:07.467: INFO: downward-api-82e0d9a9-735b-420a-b285-b64fe50b7ba3 started at 2021-05-07 21:43:11 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container dapi-container ready: false, restart count 0 May 7 21:44:07.467: INFO: affinity-nodeport-frmqs started at 2021-05-07 21:43:23 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container affinity-nodeport ready: true, restart count 0 May 7 21:44:07.467: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:44:07.467: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:44:07.467: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:44:07.467: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:44:07.467: INFO: Container node-exporter ready: true, restart count 0 May 7 21:44:07.467: INFO: test-rolling-update-controller-28bnh started at 2021-05-07 21:39:18 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container httpd ready: false, restart count 0 May 7 21:44:07.467: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:44:07.467: INFO: Init container install-cni ready: true, restart count 2 May 7 21:44:07.467: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:44:07.467: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container kube-multus ready: true, restart count 1 May 7 21:44:07.467: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:44:07.467: INFO: Container tas-controller ready: true, restart count 0 May 7 21:44:07.467: INFO: Container tas-extender ready: true, restart count 0 May 7 21:44:07.467: INFO: execpod-affinityxbjwl started at 2021-05-07 21:43:29 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container agnhost-container ready: true, restart count 0 May 7 21:44:07.467: INFO: pod-secrets-8b58a54a-3887-4824-91d9-69c0b59feab5 started at 2021-05-07 21:42:32 +0000 UTC (0+3 container statuses recorded) May 7 21:44:07.467: INFO: Container creates-volume-test ready: true, restart count 0 May 7 21:44:07.467: INFO: Container dels-volume-test ready: true, restart count 0 May 7 21:44:07.467: INFO: Container upds-volume-test ready: true, restart count 0 May 7 21:44:07.467: INFO: affinity-nodeport-8hg54 started at 2021-05-07 21:43:23 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container affinity-nodeport ready: true, restart count 0 May 7 21:44:07.467: INFO: update-demo-nautilus-5tbl6 started at 2021-05-07 21:43:56 +0000 UTC (0+1 container statuses recorded) May 7 21:44:07.467: INFO: Container update-demo ready: false, restart count 0 W0507 21:44:07.480430 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:44:07.520: INFO: Latency metrics for node node2 May 7 21:44:07.520: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-4089" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:50:06.481: Unexpected error: <*errors.errorString | 0xc000afc030>: { s: "expected pod \"downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626\" success: Gave up after waiting 5m0s for pod \"downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626\" to be \"Succeeded or Failed\"", } expected pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626" success: Gave up after waiting 5m0s for pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:45:03.852: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [It] should provide pod UID as env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward api env vars May 7 21:45:03.884: INFO: Waiting up to 5m0s for pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626" in namespace "downward-api-4498" to be "Succeeded or Failed" May 7 21:45:03.886: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1.788677ms May 7 21:45:05.889: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004725565s May 7 21:45:07.891: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007521315s May 7 21:45:09.894: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 6.01012928s May 7 21:45:11.897: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 8.013540079s May 7 21:45:13.901: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 10.016791311s May 7 21:45:15.905: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 12.020690987s May 7 21:45:17.907: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 14.023334277s May 7 21:45:19.910: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 16.026237351s May 7 21:45:21.913: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 18.029012034s May 7 21:45:23.917: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 20.032990209s May 7 21:45:25.920: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 22.035862216s May 7 21:45:27.923: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 24.039469127s May 7 21:45:29.926: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 26.042665747s May 7 21:45:31.929: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 28.045399546s May 7 21:45:33.933: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 30.049371594s May 7 21:45:35.937: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 32.052999809s May 7 21:45:37.940: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 34.055862814s May 7 21:45:39.943: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 36.0594509s May 7 21:45:41.947: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 38.062883268s May 7 21:45:43.950: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 40.066494241s May 7 21:45:45.954: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 42.070274625s May 7 21:45:47.959: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 44.075051676s May 7 21:45:49.963: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 46.078946215s May 7 21:45:51.966: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 48.082319166s May 7 21:45:53.969: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 50.085584306s May 7 21:45:55.972: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 52.088584486s May 7 21:45:57.976: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 54.092123858s May 7 21:45:59.980: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 56.096627821s May 7 21:46:01.983: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 58.099614258s May 7 21:46:03.990: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.105682338s May 7 21:46:05.993: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.109549245s May 7 21:46:07.997: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.113097885s May 7 21:46:10.001: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.11675827s May 7 21:46:12.004: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.120526174s May 7 21:46:14.009: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.125021887s May 7 21:46:16.013: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.129405937s May 7 21:46:18.016: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.132660531s May 7 21:46:20.019: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.135280525s May 7 21:46:22.023: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.139179052s May 7 21:46:24.026: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.142118298s May 7 21:46:26.029: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.144851735s May 7 21:46:28.032: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.148080559s May 7 21:46:30.036: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.151847753s May 7 21:46:32.039: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.154815533s May 7 21:46:34.042: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.158011344s May 7 21:46:36.044: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.160642597s May 7 21:46:38.048: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.16381863s May 7 21:46:40.051: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.167589247s May 7 21:46:42.055: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.170943096s May 7 21:46:44.058: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.173820284s May 7 21:46:46.061: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.176926688s May 7 21:46:48.064: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.180123405s May 7 21:46:50.068: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.184080387s May 7 21:46:52.071: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.187041007s May 7 21:46:54.074: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.189921805s May 7 21:46:56.077: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.193053621s May 7 21:46:58.080: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.195939173s May 7 21:47:00.083: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.199311826s May 7 21:47:02.086: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.202282224s May 7 21:47:04.092: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.207789675s May 7 21:47:06.097: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.212733751s May 7 21:47:08.100: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.216592436s May 7 21:47:10.104: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.220485516s May 7 21:47:12.108: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.223696524s May 7 21:47:14.110: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.226233383s May 7 21:47:16.114: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.230457872s May 7 21:47:18.119: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.234857316s May 7 21:47:20.122: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.238648125s May 7 21:47:22.125: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.241480703s May 7 21:47:24.129: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.244808338s May 7 21:47:26.131: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.247610542s May 7 21:47:28.135: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.250870048s May 7 21:47:30.138: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.253913573s May 7 21:47:32.142: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.25804906s May 7 21:47:34.146: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.262267857s May 7 21:47:36.150: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.265671845s May 7 21:47:38.153: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.269312845s May 7 21:47:40.156: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.272594325s May 7 21:47:42.160: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.275931078s May 7 21:47:44.164: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.279719464s May 7 21:47:46.168: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.283685708s May 7 21:47:48.171: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.287663845s May 7 21:47:50.175: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.291607383s May 7 21:47:52.181: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.296968896s May 7 21:47:54.185: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.301378675s May 7 21:47:56.189: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.30558937s May 7 21:47:58.193: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.308700295s May 7 21:48:00.197: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.313605023s May 7 21:48:02.201: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.317612242s May 7 21:48:04.208: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.323858149s May 7 21:48:06.212: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.328581883s May 7 21:48:08.216: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.331993581s May 7 21:48:10.220: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.335944251s May 7 21:48:12.224: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.34043751s May 7 21:48:14.230: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.345850091s May 7 21:48:16.235: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.350702534s May 7 21:48:18.239: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.355033548s May 7 21:48:20.244: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.360642154s May 7 21:48:22.249: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.364705534s May 7 21:48:24.253: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.369469633s May 7 21:48:26.259: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.37476387s May 7 21:48:28.262: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.378425256s May 7 21:48:30.266: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.382296357s May 7 21:48:32.270: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.386388558s May 7 21:48:34.273: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.388853816s May 7 21:48:36.280: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.396659818s May 7 21:48:38.284: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.39999027s May 7 21:48:40.287: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.402855248s May 7 21:48:42.289: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.405556585s May 7 21:48:44.296: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.412536465s May 7 21:48:46.302: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.41853821s May 7 21:48:48.305: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.421263768s May 7 21:48:50.310: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.426438319s May 7 21:48:52.315: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.431066502s May 7 21:48:54.319: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.434756178s May 7 21:48:56.323: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.438738499s May 7 21:48:58.326: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.442554071s May 7 21:49:00.330: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.446428227s May 7 21:49:02.335: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.45095491s May 7 21:49:04.343: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.459029619s May 7 21:49:06.348: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.463813027s May 7 21:49:08.351: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.46672771s May 7 21:49:10.357: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.473587595s May 7 21:49:12.363: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.478694959s May 7 21:49:14.366: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.482305621s May 7 21:49:16.369: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.485409507s May 7 21:49:18.373: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.488689002s May 7 21:49:20.376: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.492502884s May 7 21:49:22.380: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.496149884s May 7 21:49:24.384: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.500098289s May 7 21:49:26.387: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.503049153s May 7 21:49:28.389: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.505605825s May 7 21:49:30.394: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.509703369s May 7 21:49:32.397: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.513550805s May 7 21:49:34.402: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.518140492s May 7 21:49:36.405: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.521612518s May 7 21:49:38.409: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.525410928s May 7 21:49:40.415: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.531159922s May 7 21:49:42.419: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.535027861s May 7 21:49:44.422: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.538070719s May 7 21:49:46.426: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.542002942s May 7 21:49:48.429: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.545461584s May 7 21:49:50.433: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.548723812s May 7 21:49:52.436: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.552639703s May 7 21:49:54.440: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.556114021s May 7 21:49:56.443: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.559195888s May 7 21:49:58.448: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.563990252s May 7 21:50:00.450: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.566558083s May 7 21:50:02.456: INFO: Pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.571844028s May 7 21:50:04.467: INFO: Failed to get logs from node "node1" pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626" container "dapi-container": the server rejected our request for an unknown reason (get pods downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626) STEP: delete the pod May 7 21:50:04.475: INFO: Waiting for pod downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626 to disappear May 7 21:50:04.477: INFO: Pod downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626 still exists May 7 21:50:06.477: INFO: Waiting for pod downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626 to disappear May 7 21:50:06.480: INFO: Pod downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626 no longer exists May 7 21:50:06.481: FAIL: Unexpected error: <*errors.errorString | 0xc000afc030>: { s: "expected pod \"downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626\" success: Gave up after waiting 5m0s for pod \"downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626\" to be \"Succeeded or Failed\"", } expected pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626" success: Gave up after waiting 5m0s for pod "downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0012c0000, 0x4c29f00, 0x15, 0xc000943400, 0x0, 0xc008dc51c8, 0x1, 0x1, 0x4de7490) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutputRegexp(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:532 k8s.io/kubernetes/test/e2e/common.testDownwardAPIUsingPod(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:425 k8s.io/kubernetes/test/e2e/common.testDownwardAPI(0xc0012c0000, 0xc004aad400, 0x31, 0xc004fdc150, 0x1, 0x1, 0xc008dc51c8, 0x1, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:391 +0x75c k8s.io/kubernetes/test/e2e/common.glob..func5.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:283 +0x199 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003541380, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "downward-api-4498". STEP: Found 7 events. May 7 21:50:06.487: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626: { } Scheduled: Successfully assigned downward-api-4498/downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626 to node1 May 7 21:50:06.487: INFO: At 2021-05-07 21:45:05 +0000 UTC - event for downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626: {multus } AddedInterface: Add eth0 [10.244.3.170/24] May 7 21:50:06.487: INFO: At 2021-05-07 21:45:05 +0000 UTC - event for downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 7 21:50:06.487: INFO: At 2021-05-07 21:45:06 +0000 UTC - event for downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:50:06.487: INFO: At 2021-05-07 21:45:06 +0000 UTC - event for downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626: {kubelet node1} Failed: Error: ErrImagePull May 7 21:50:06.487: INFO: At 2021-05-07 21:45:06 +0000 UTC - event for downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 7 21:50:06.487: INFO: At 2021-05-07 21:45:06 +0000 UTC - event for downward-api-d6ead80e-dcb7-4a85-a3f4-115973131626: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:50:06.490: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:50:06.490: INFO: May 7 21:50:06.495: INFO: Logging node info for node master1 May 7 21:50:06.498: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 42063 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:50:00 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:50:00 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:50:00 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:50:00 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:50:06.499: INFO: Logging kubelet events for node master1 May 7 21:50:06.501: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:50:06.514: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:50:06.514: INFO: Container docker-registry ready: true, restart count 0 May 7 21:50:06.514: INFO: Container nginx ready: true, restart count 0 May 7 21:50:06.514: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:50:06.514: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:50:06.514: INFO: Container prometheus-operator ready: true, restart count 0 May 7 21:50:06.514: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.514: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:50:06.514: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.514: INFO: Container kube-multus ready: true, restart count 1 May 7 21:50:06.514: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.514: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:50:06.514: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:50:06.514: INFO: Init container install-cni ready: true, restart count 0 May 7 21:50:06.514: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:50:06.514: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.514: INFO: Container coredns ready: true, restart count 2 May 7 21:50:06.514: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.514: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:50:06.514: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:50:06.514: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:50:06.514: INFO: Container node-exporter ready: true, restart count 0 May 7 21:50:06.514: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.514: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:50:06.514: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.514: INFO: Container kube-controller-manager ready: true, restart count 2 W0507 21:50:06.529232 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:50:06.555: INFO: Latency metrics for node master1 May 7 21:50:06.556: INFO: Logging node info for node master2 May 7 21:50:06.558: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 42051 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:57 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:57 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:57 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:49:57 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:50:06.558: INFO: Logging kubelet events for node master2 May 7 21:50:06.560: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:50:06.568: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.568: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:50:06.568: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:50:06.568: INFO: Init container install-cni ready: true, restart count 0 May 7 21:50:06.568: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:50:06.568: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.568: INFO: Container kube-multus ready: true, restart count 1 May 7 21:50:06.568: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.568: INFO: Container autoscaler ready: true, restart count 2 May 7 21:50:06.568: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:50:06.568: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:50:06.568: INFO: Container node-exporter ready: true, restart count 0 May 7 21:50:06.568: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.568: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:50:06.568: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.568: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:50:06.568: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.568: INFO: Container kube-scheduler ready: true, restart count 2 W0507 21:50:06.582803 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:50:06.614: INFO: Latency metrics for node master2 May 7 21:50:06.614: INFO: Logging node info for node master3 May 7 21:50:06.616: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 42050 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:56 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:56 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:56 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:49:56 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:50:06.617: INFO: Logging kubelet events for node master3 May 7 21:50:06.619: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:50:06.627: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:50:06.627: INFO: Init container install-cni ready: true, restart count 1 May 7 21:50:06.627: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:50:06.627: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.627: INFO: Container kube-multus ready: true, restart count 1 May 7 21:50:06.627: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.627: INFO: Container coredns ready: true, restart count 2 May 7 21:50:06.627: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:50:06.627: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:50:06.627: INFO: Container node-exporter ready: true, restart count 0 May 7 21:50:06.627: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.627: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:50:06.627: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.627: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:50:06.627: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.627: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:50:06.627: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.627: INFO: Container kube-proxy ready: true, restart count 1 W0507 21:50:06.640293 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:50:06.667: INFO: Latency metrics for node master3 May 7 21:50:06.667: INFO: Logging node info for node node1 May 7 21:50:06.669: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 42062 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:59 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:59 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:59 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:49:59 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:50:06.670: INFO: Logging kubelet events for node node1 May 7 21:50:06.672: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:50:06.686: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.686: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:50:06.686: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:50:06.686: INFO: Container discover ready: false, restart count 0 May 7 21:50:06.686: INFO: Container init ready: false, restart count 0 May 7 21:50:06.686: INFO: Container install ready: false, restart count 0 May 7 21:50:06.686: INFO: pod-update-activedeadlineseconds-e819ac2a-3547-4d36-955f-07030411db90 started at 2021-05-07 21:47:48 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.686: INFO: Container nginx ready: false, restart count 0 May 7 21:50:06.686: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:50:06.686: INFO: Container nodereport ready: true, restart count 0 May 7 21:50:06.686: INFO: Container reconcile ready: true, restart count 0 May 7 21:50:06.686: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.686: INFO: Container kube-multus ready: true, restart count 1 May 7 21:50:06.686: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:50:06.686: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:50:06.686: INFO: Container grafana ready: true, restart count 0 May 7 21:50:06.686: INFO: Container prometheus ready: true, restart count 1 May 7 21:50:06.686: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:50:06.686: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 7 21:50:06.686: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:50:06.687: INFO: Init container install-cni ready: true, restart count 2 May 7 21:50:06.687: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:50:06.687: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:50:06.687: INFO: Container collectd ready: true, restart count 0 May 7 21:50:06.687: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:50:06.687: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:50:06.687: INFO: ss-0 started at 2021-05-07 21:49:46 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.687: INFO: Container webserver ready: false, restart count 0 May 7 21:50:06.687: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.687: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:50:06.687: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.687: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:50:06.687: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.687: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:50:06.687: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:50:06.687: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:50:06.687: INFO: Container node-exporter ready: true, restart count 0 May 7 21:50:06.687: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.687: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:50:06.687: INFO: busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e started at 2021-05-07 21:48:32 +0000 UTC (0+1 container statuses recorded) May 7 21:50:06.687: INFO: Container busybox-user-65534-840f36a9-60ac-45c7-bea5-fa432d34c75e ready: false, restart count 0 W0507 21:50:06.701310 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:50:06.987: INFO: Latency metrics for node node1 May 7 21:50:06.987: INFO: Logging node info for node node2 May 7 21:50:06.989: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 42056 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:57 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:57 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:49:57 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:49:57 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:50:06.990: INFO: Logging kubelet events for node node2 May 7 21:50:06.992: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:50:07.006: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.006: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:50:07.006: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:50:07.006: INFO: Container discover ready: false, restart count 0 May 7 21:50:07.006: INFO: Container init ready: false, restart count 0 May 7 21:50:07.006: INFO: Container install ready: false, restart count 0 May 7 21:50:07.006: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:50:07.006: INFO: Container nodereport ready: true, restart count 0 May 7 21:50:07.006: INFO: Container reconcile ready: true, restart count 0 May 7 21:50:07.006: INFO: server started at 2021-05-07 21:45:09 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.006: INFO: Container agnhost-container ready: true, restart count 0 May 7 21:50:07.006: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.006: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:50:07.006: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:50:07.006: INFO: Container collectd ready: true, restart count 0 May 7 21:50:07.006: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:50:07.006: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:50:07.006: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.006: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:50:07.006: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.006: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:50:07.006: INFO: termination-message-container6b63d0f6-861d-4f34-a23b-0b75d7cbfbfc started at 2021-05-07 21:49:02 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.006: INFO: Container termination-message-container ready: false, restart count 0 May 7 21:50:07.006: INFO: pod-init-625841d8-80f4-4efd-a0cb-284795949ea7 started at 2021-05-07 21:47:12 +0000 UTC (2+1 container statuses recorded) May 7 21:50:07.006: INFO: Init container init1 ready: false, restart count 0 May 7 21:50:07.006: INFO: Init container init2 ready: false, restart count 0 May 7 21:50:07.006: INFO: Container run1 ready: false, restart count 0 May 7 21:50:07.006: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.006: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:50:07.006: INFO: ss-0 started at 2021-05-07 21:45:26 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.006: INFO: Container webserver ready: false, restart count 0 May 7 21:50:07.006: INFO: termination-message-containerfc88aebc-fbfe-4fbf-a9f7-d1b11da2e91d started at 2021-05-07 21:48:15 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.006: INFO: Container termination-message-container ready: false, restart count 0 May 7 21:50:07.006: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.006: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:50:07.006: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:50:07.006: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:50:07.006: INFO: Container node-exporter ready: true, restart count 0 May 7 21:50:07.006: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:50:07.006: INFO: Init container install-cni ready: true, restart count 2 May 7 21:50:07.006: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:50:07.007: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.007: INFO: Container kube-multus ready: true, restart count 1 May 7 21:50:07.007: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:50:07.007: INFO: Container tas-controller ready: true, restart count 0 May 7 21:50:07.007: INFO: Container tas-extender ready: true, restart count 0 May 7 21:50:07.007: INFO: ss-0 started at 2021-05-07 21:41:12 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.007: INFO: Container webserver ready: false, restart count 0 May 7 21:50:07.007: INFO: tester started at 2021-05-07 21:45:13 +0000 UTC (0+1 container statuses recorded) May 7 21:50:07.007: INFO: Container tester ready: false, restart count 0 W0507 21:50:07.019915 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:50:07.050: INFO: Latency metrics for node node2 May 7 21:50:07.050: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-4498" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:55:07.116: Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 {"msg":"FAILED [sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","total":-1,"completed":29,"skipped":749,"failed":4,"failures":["[sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]","[sig-cli] Kubectl client Kubectl replace should update a single-container pod's image [Conformance]","[sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]"]} [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:50:07.065: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should be updated [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod STEP: submitting the pod to kubernetes May 7 21:55:07.116: FAIL: Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0044747a0, 0xc00222b800, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func18.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:369 +0x498 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003541380, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-1841". STEP: Found 7 events. May 7 21:55:07.122: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d: { } Scheduled: Successfully assigned pods-1841/pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d to node1 May 7 21:55:07.122: INFO: At 2021-05-07 21:50:08 +0000 UTC - event for pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d: {multus } AddedInterface: Add eth0 [10.244.3.182/24] May 7 21:55:07.122: INFO: At 2021-05-07 21:50:08 +0000 UTC - event for pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d: {kubelet node1} Pulling: Pulling image "docker.io/library/nginx:1.14-alpine" May 7 21:55:07.122: INFO: At 2021-05-07 21:50:09 +0000 UTC - event for pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d: {kubelet node1} Failed: Failed to pull image "docker.io/library/nginx:1.14-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 7 21:55:07.122: INFO: At 2021-05-07 21:50:09 +0000 UTC - event for pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d: {kubelet node1} Failed: Error: ErrImagePull May 7 21:55:07.122: INFO: At 2021-05-07 21:50:10 +0000 UTC - event for pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/nginx:1.14-alpine" May 7 21:55:07.122: INFO: At 2021-05-07 21:50:10 +0000 UTC - event for pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d: {kubelet node1} Failed: Error: ImagePullBackOff May 7 21:55:07.124: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:55:07.124: INFO: pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:50:07 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:50:07 +0000 UTC ContainersNotReady containers with unready status: [nginx]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:50:07 +0000 UTC ContainersNotReady containers with unready status: [nginx]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-07 21:50:07 +0000 UTC }] May 7 21:55:07.124: INFO: May 7 21:55:07.128: INFO: Logging node info for node master1 May 7 21:55:07.132: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 44548 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:55:01 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:55:01 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:55:01 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:55:01 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:55:07.133: INFO: Logging kubelet events for node master1 May 7 21:55:07.135: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:55:07.145: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.145: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:55:07.145: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.145: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:55:07.145: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.145: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:55:07.145: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:55:07.145: INFO: Init container install-cni ready: true, restart count 0 May 7 21:55:07.145: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:55:07.145: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.145: INFO: Container coredns ready: true, restart count 2 May 7 21:55:07.145: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.145: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:55:07.145: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:55:07.145: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:55:07.145: INFO: Container node-exporter ready: true, restart count 0 May 7 21:55:07.145: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.145: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:55:07.145: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.145: INFO: Container kube-multus ready: true, restart count 1 May 7 21:55:07.145: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:55:07.145: INFO: Container docker-registry ready: true, restart count 0 May 7 21:55:07.145: INFO: Container nginx ready: true, restart count 0 May 7 21:55:07.145: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:55:07.145: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:55:07.145: INFO: Container prometheus-operator ready: true, restart count 0 W0507 21:55:07.160159 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:55:07.186: INFO: Latency metrics for node master1 May 7 21:55:07.186: INFO: Logging node info for node master2 May 7 21:55:07.189: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 44534 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:54:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:54:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:54:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:54:58 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:55:07.190: INFO: Logging kubelet events for node master2 May 7 21:55:07.193: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:55:07.201: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:55:07.201: INFO: Init container install-cni ready: true, restart count 0 May 7 21:55:07.201: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:55:07.201: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.201: INFO: Container kube-multus ready: true, restart count 1 May 7 21:55:07.201: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.201: INFO: Container autoscaler ready: true, restart count 2 May 7 21:55:07.201: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:55:07.201: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:55:07.201: INFO: Container node-exporter ready: true, restart count 0 May 7 21:55:07.201: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.201: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:55:07.201: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.201: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:55:07.201: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.202: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:55:07.202: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.202: INFO: Container kube-proxy ready: true, restart count 1 W0507 21:55:07.215773 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:55:07.244: INFO: Latency metrics for node master2 May 7 21:55:07.244: INFO: Logging node info for node master3 May 7 21:55:07.246: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 44529 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:54:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:54:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:54:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:54:58 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:55:07.247: INFO: Logging kubelet events for node master3 May 7 21:55:07.249: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:55:07.257: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.257: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:55:07.257: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.257: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:55:07.257: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.257: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:55:07.257: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.257: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:55:07.257: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:55:07.257: INFO: Init container install-cni ready: true, restart count 1 May 7 21:55:07.257: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:55:07.257: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.257: INFO: Container kube-multus ready: true, restart count 1 May 7 21:55:07.257: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.257: INFO: Container coredns ready: true, restart count 2 May 7 21:55:07.257: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:55:07.257: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:55:07.257: INFO: Container node-exporter ready: true, restart count 0 W0507 21:55:07.272501 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:55:07.296: INFO: Latency metrics for node master3 May 7 21:55:07.296: INFO: Logging node info for node node1 May 7 21:55:07.300: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 44545 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:55:00 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:55:00 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:55:00 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:55:00 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:55:07.301: INFO: Logging kubelet events for node node1 May 7 21:55:07.303: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:55:07.317: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:55:07.317: INFO: Container nodereport ready: true, restart count 0 May 7 21:55:07.317: INFO: Container reconcile ready: true, restart count 0 May 7 21:55:07.317: INFO: webserver-deployment-dd94f59b7-54hd5 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container httpd ready: false, restart count 0 May 7 21:55:07.317: INFO: busybox-ac3d0690-4843-49d0-b3f1-33b5df613ef0 started at 2021-05-07 21:51:23 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container busybox ready: false, restart count 0 May 7 21:55:07.317: INFO: webserver-deployment-dd94f59b7-rvv98 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container httpd ready: false, restart count 0 May 7 21:55:07.317: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container kube-multus ready: true, restart count 1 May 7 21:55:07.317: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:55:07.317: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:55:07.317: INFO: Container grafana ready: true, restart count 0 May 7 21:55:07.317: INFO: Container prometheus ready: true, restart count 1 May 7 21:55:07.317: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:55:07.317: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 7 21:55:07.317: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:55:07.317: INFO: Init container install-cni ready: true, restart count 2 May 7 21:55:07.317: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:55:07.317: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:55:07.317: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:55:07.317: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:55:07.317: INFO: Container node-exporter ready: true, restart count 0 May 7 21:55:07.317: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:55:07.317: INFO: Container collectd ready: true, restart count 0 May 7 21:55:07.317: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:55:07.317: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:55:07.317: INFO: ss-0 started at 2021-05-07 21:49:46 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container webserver ready: false, restart count 0 May 7 21:55:07.317: INFO: pod-configmaps-492a36ce-a6ac-401e-9fb5-5e28913c3fd4 started at 2021-05-07 21:54:10 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container env-test ready: false, restart count 0 May 7 21:55:07.317: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:55:07.317: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:55:07.317: INFO: webserver-deployment-dd94f59b7-gnnrp started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container httpd ready: false, restart count 0 May 7 21:55:07.317: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:55:07.317: INFO: pod-update-628df06c-d0c2-42f1-b552-8cf8ea60d17d started at 2021-05-07 21:50:07 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container nginx ready: false, restart count 0 May 7 21:55:07.317: INFO: webserver-deployment-dd94f59b7-7xggp started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container httpd ready: false, restart count 0 May 7 21:55:07.317: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:55:07.317: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:55:07.317: INFO: Container discover ready: false, restart count 0 May 7 21:55:07.317: INFO: Container init ready: false, restart count 0 May 7 21:55:07.317: INFO: Container install ready: false, restart count 0 May 7 21:55:07.317: INFO: webserver-deployment-dd94f59b7-lkk66 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.317: INFO: Container httpd ready: false, restart count 0 W0507 21:55:07.332679 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:55:07.390: INFO: Latency metrics for node node1 May 7 21:55:07.390: INFO: Logging node info for node node2 May 7 21:55:07.393: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 44544 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:55:00 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:55:00 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:55:00 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:55:00 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:55:07.394: INFO: Logging kubelet events for node node2 May 7 21:55:07.396: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:55:07.411: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:55:07.411: INFO: webserver-deployment-dd94f59b7-hbp9l started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container httpd ready: false, restart count 0 May 7 21:55:07.411: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:55:07.411: INFO: ss-0 started at 2021-05-07 21:45:26 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container webserver ready: false, restart count 0 May 7 21:55:07.411: INFO: var-expansion-d2278004-0232-4b36-8c86-6f125c4c8a60 started at 2021-05-07 21:52:37 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container dapi-container ready: false, restart count 0 May 7 21:55:07.411: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:55:07.411: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:55:07.411: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:55:07.411: INFO: Container node-exporter ready: true, restart count 0 May 7 21:55:07.411: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:55:07.411: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container kube-multus ready: true, restart count 1 May 7 21:55:07.411: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:55:07.411: INFO: Container tas-controller ready: true, restart count 0 May 7 21:55:07.411: INFO: Container tas-extender ready: true, restart count 0 May 7 21:55:07.411: INFO: webserver-deployment-dd94f59b7-7d7h2 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container httpd ready: false, restart count 0 May 7 21:55:07.411: INFO: webserver-deployment-dd94f59b7-rqdcf started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container httpd ready: false, restart count 0 May 7 21:55:07.411: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:55:07.411: INFO: Init container install-cni ready: true, restart count 2 May 7 21:55:07.411: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:55:07.411: INFO: busybox-host-aliasesa735d79b-e791-4100-b1f8-245b814cd445 started at 2021-05-07 21:53:16 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container busybox-host-aliasesa735d79b-e791-4100-b1f8-245b814cd445 ready: false, restart count 0 May 7 21:55:07.411: INFO: bin-false58d6a01c-d649-4e19-936c-155835d5eaeb started at 2021-05-07 21:50:41 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container bin-false58d6a01c-d649-4e19-936c-155835d5eaeb ready: false, restart count 0 May 7 21:55:07.411: INFO: webserver-deployment-dd94f59b7-smk7q started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container httpd ready: false, restart count 0 May 7 21:55:07.411: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:55:07.411: INFO: Container discover ready: false, restart count 0 May 7 21:55:07.411: INFO: Container init ready: false, restart count 0 May 7 21:55:07.411: INFO: Container install ready: false, restart count 0 May 7 21:55:07.411: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:55:07.411: INFO: Container nodereport ready: true, restart count 0 May 7 21:55:07.411: INFO: Container reconcile ready: true, restart count 0 May 7 21:55:07.411: INFO: pod-projected-configmaps-a5fe39c6-4ee3-4a52-9eaf-e51495ef7e75 started at 2021-05-07 21:54:03 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container projected-configmap-volume-test ready: true, restart count 0 May 7 21:55:07.411: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:55:07.411: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:55:07.411: INFO: Container collectd ready: true, restart count 0 May 7 21:55:07.411: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:55:07.411: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:55:07.411: INFO: webserver-deployment-dd94f59b7-wgwgb started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container httpd ready: false, restart count 0 May 7 21:55:07.411: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:55:07.411: INFO: Container cmk-webhook ready: true, restart count 0 W0507 21:55:07.424340 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:55:07.457: INFO: Latency metrics for node node2 May 7 21:55:07.457: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-1841" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 7 21:57:54.699: Unexpected error: <*errors.errorString | 0xc0002c3570>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30130 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30130 over TCP protocol occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 7 21:55:42.228: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service in namespace services-8811 STEP: creating service affinity-nodeport-transition in namespace services-8811 STEP: creating replication controller affinity-nodeport-transition in namespace services-8811 I0507 21:55:42.257620 24 runners.go:190] Created replication controller with name: affinity-nodeport-transition, namespace: services-8811, replica count: 3 I0507 21:55:45.308369 24 runners.go:190] affinity-nodeport-transition Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0507 21:55:48.308714 24 runners.go:190] affinity-nodeport-transition Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady May 7 21:55:48.317: INFO: Creating new exec pod May 7 21:55:53.340: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 affinity-nodeport-transition 80' May 7 21:55:53.625: INFO: stderr: "+ nc -zv -t -w 2 affinity-nodeport-transition 80\nConnection to affinity-nodeport-transition 80 port [tcp/http] succeeded!\n" May 7 21:55:53.625: INFO: stdout: "" May 7 21:55:53.626: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.233.13.17 80' May 7 21:55:53.893: INFO: stderr: "+ nc -zv -t -w 2 10.233.13.17 80\nConnection to 10.233.13.17 80 port [tcp/http] succeeded!\n" May 7 21:55:53.893: INFO: stdout: "" May 7 21:55:53.893: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:55:54.158: INFO: rc: 1 May 7 21:55:54.158: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:55:55.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:55:55.429: INFO: rc: 1 May 7 21:55:55.429: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:55:56.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:55:56.416: INFO: rc: 1 May 7 21:55:56.416: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:55:57.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:55:57.426: INFO: rc: 1 May 7 21:55:57.426: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:55:58.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:55:58.440: INFO: rc: 1 May 7 21:55:58.440: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:55:59.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:55:59.411: INFO: rc: 1 May 7 21:55:59.411: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:00.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:00.419: INFO: rc: 1 May 7 21:56:00.419: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:01.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:01.416: INFO: rc: 1 May 7 21:56:01.416: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:02.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:02.419: INFO: rc: 1 May 7 21:56:02.419: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:03.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:03.417: INFO: rc: 1 May 7 21:56:03.417: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:04.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:04.400: INFO: rc: 1 May 7 21:56:04.400: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:05.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:05.421: INFO: rc: 1 May 7 21:56:05.421: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:06.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:07.187: INFO: rc: 1 May 7 21:56:07.187: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:08.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:08.430: INFO: rc: 1 May 7 21:56:08.430: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:09.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:09.432: INFO: rc: 1 May 7 21:56:09.432: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:10.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:10.447: INFO: rc: 1 May 7 21:56:10.447: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:11.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:11.430: INFO: rc: 1 May 7 21:56:11.430: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:12.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:12.431: INFO: rc: 1 May 7 21:56:12.431: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:13.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:13.413: INFO: rc: 1 May 7 21:56:13.413: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:14.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:14.429: INFO: rc: 1 May 7 21:56:14.429: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:15.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:15.440: INFO: rc: 1 May 7 21:56:15.440: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:16.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:16.431: INFO: rc: 1 May 7 21:56:16.431: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:17.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:17.423: INFO: rc: 1 May 7 21:56:17.423: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:18.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:18.423: INFO: rc: 1 May 7 21:56:18.423: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:19.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:19.442: INFO: rc: 1 May 7 21:56:19.442: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:20.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:20.408: INFO: rc: 1 May 7 21:56:20.408: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:21.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:21.440: INFO: rc: 1 May 7 21:56:21.440: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:22.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:22.459: INFO: rc: 1 May 7 21:56:22.459: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:23.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:23.597: INFO: rc: 1 May 7 21:56:23.597: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:24.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:24.424: INFO: rc: 1 May 7 21:56:24.424: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:25.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:25.428: INFO: rc: 1 May 7 21:56:25.428: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:26.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:26.426: INFO: rc: 1 May 7 21:56:26.426: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:27.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:27.394: INFO: rc: 1 May 7 21:56:27.394: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:28.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:28.404: INFO: rc: 1 May 7 21:56:28.404: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:29.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:29.407: INFO: rc: 1 May 7 21:56:29.407: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:30.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:30.410: INFO: rc: 1 May 7 21:56:30.410: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:31.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:31.425: INFO: rc: 1 May 7 21:56:31.425: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:32.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:32.441: INFO: rc: 1 May 7 21:56:32.442: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:33.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:33.413: INFO: rc: 1 May 7 21:56:33.413: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:34.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:34.425: INFO: rc: 1 May 7 21:56:34.425: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:35.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:35.417: INFO: rc: 1 May 7 21:56:35.417: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:36.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:37.180: INFO: rc: 1 May 7 21:56:37.180: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:38.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:38.435: INFO: rc: 1 May 7 21:56:38.435: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:39.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:39.415: INFO: rc: 1 May 7 21:56:39.415: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:40.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:40.416: INFO: rc: 1 May 7 21:56:40.416: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:41.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:41.430: INFO: rc: 1 May 7 21:56:41.430: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:42.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:42.418: INFO: rc: 1 May 7 21:56:42.418: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:43.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:43.426: INFO: rc: 1 May 7 21:56:43.426: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:44.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:44.432: INFO: rc: 1 May 7 21:56:44.432: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:45.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:45.431: INFO: rc: 1 May 7 21:56:45.431: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:46.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:46.430: INFO: rc: 1 May 7 21:56:46.430: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:47.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:47.438: INFO: rc: 1 May 7 21:56:47.438: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:48.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:48.425: INFO: rc: 1 May 7 21:56:48.425: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:49.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:49.441: INFO: rc: 1 May 7 21:56:49.441: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:50.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:50.442: INFO: rc: 1 May 7 21:56:50.443: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:51.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:51.440: INFO: rc: 1 May 7 21:56:51.440: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:52.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:52.430: INFO: rc: 1 May 7 21:56:52.430: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:53.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:53.422: INFO: rc: 1 May 7 21:56:53.422: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:54.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:54.759: INFO: rc: 1 May 7 21:56:54.759: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:55.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:55.438: INFO: rc: 1 May 7 21:56:55.438: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:56.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:56.431: INFO: rc: 1 May 7 21:56:56.431: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:57.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:57.414: INFO: rc: 1 May 7 21:56:57.414: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:58.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:58.418: INFO: rc: 1 May 7 21:56:58.418: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:56:59.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:56:59.427: INFO: rc: 1 May 7 21:56:59.427: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:00.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:00.437: INFO: rc: 1 May 7 21:57:00.437: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:01.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:01.419: INFO: rc: 1 May 7 21:57:01.419: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:02.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:02.428: INFO: rc: 1 May 7 21:57:02.428: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:03.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:03.432: INFO: rc: 1 May 7 21:57:03.432: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:04.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:04.430: INFO: rc: 1 May 7 21:57:04.430: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:05.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:05.406: INFO: rc: 1 May 7 21:57:05.406: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:06.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:07.023: INFO: rc: 1 May 7 21:57:07.023: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:07.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:07.417: INFO: rc: 1 May 7 21:57:07.417: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:08.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:08.421: INFO: rc: 1 May 7 21:57:08.422: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:09.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:09.441: INFO: rc: 1 May 7 21:57:09.441: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:10.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:10.405: INFO: rc: 1 May 7 21:57:10.405: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:11.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:11.440: INFO: rc: 1 May 7 21:57:11.440: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:12.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:12.440: INFO: rc: 1 May 7 21:57:12.440: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:13.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:13.423: INFO: rc: 1 May 7 21:57:13.423: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:14.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:14.425: INFO: rc: 1 May 7 21:57:14.425: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:15.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:15.419: INFO: rc: 1 May 7 21:57:15.419: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:16.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:16.419: INFO: rc: 1 May 7 21:57:16.419: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:17.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:17.437: INFO: rc: 1 May 7 21:57:17.437: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:18.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:18.426: INFO: rc: 1 May 7 21:57:18.426: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:19.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:19.431: INFO: rc: 1 May 7 21:57:19.432: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:20.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:20.426: INFO: rc: 1 May 7 21:57:20.426: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:21.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:21.434: INFO: rc: 1 May 7 21:57:21.434: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:22.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:22.437: INFO: rc: 1 May 7 21:57:22.437: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:23.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:23.430: INFO: rc: 1 May 7 21:57:23.430: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:24.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:24.391: INFO: rc: 1 May 7 21:57:24.391: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:25.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:25.394: INFO: rc: 1 May 7 21:57:25.394: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:26.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:26.425: INFO: rc: 1 May 7 21:57:26.425: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:27.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:27.432: INFO: rc: 1 May 7 21:57:27.432: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:28.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:28.461: INFO: rc: 1 May 7 21:57:28.461: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:29.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:29.410: INFO: rc: 1 May 7 21:57:29.410: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:30.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:30.428: INFO: rc: 1 May 7 21:57:30.428: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:31.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:31.444: INFO: rc: 1 May 7 21:57:31.444: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:32.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:32.431: INFO: rc: 1 May 7 21:57:32.431: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:33.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:33.435: INFO: rc: 1 May 7 21:57:33.435: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:34.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:34.426: INFO: rc: 1 May 7 21:57:34.426: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:35.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:35.446: INFO: rc: 1 May 7 21:57:35.446: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:36.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:37.038: INFO: rc: 1 May 7 21:57:37.038: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:37.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:37.445: INFO: rc: 1 May 7 21:57:37.445: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:38.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:38.413: INFO: rc: 1 May 7 21:57:38.413: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:39.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:39.436: INFO: rc: 1 May 7 21:57:39.436: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:40.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:40.411: INFO: rc: 1 May 7 21:57:40.412: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:41.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:41.402: INFO: rc: 1 May 7 21:57:41.402: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:42.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:42.410: INFO: rc: 1 May 7 21:57:42.410: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:43.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:43.420: INFO: rc: 1 May 7 21:57:43.420: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:44.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:44.405: INFO: rc: 1 May 7 21:57:44.405: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:45.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:45.413: INFO: rc: 1 May 7 21:57:45.413: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:46.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:46.449: INFO: rc: 1 May 7 21:57:46.449: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:47.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:47.415: INFO: rc: 1 May 7 21:57:47.415: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:48.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:48.412: INFO: rc: 1 May 7 21:57:48.412: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:49.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:49.408: INFO: rc: 1 May 7 21:57:49.408: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:50.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:50.422: INFO: rc: 1 May 7 21:57:50.422: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:51.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:51.430: INFO: rc: 1 May 7 21:57:51.430: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:52.159: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:52.421: INFO: rc: 1 May 7 21:57:52.422: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:53.158: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:53.417: INFO: rc: 1 May 7 21:57:53.417: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:54.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:54.428: INFO: rc: 1 May 7 21:57:54.428: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:54.428: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130' May 7 21:57:54.698: INFO: rc: 1 May 7 21:57:54.698: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8811 exec execpod-affinity49g2t -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30130: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30130 nc: connect to 10.10.190.207 port 30130 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 7 21:57:54.699: FAIL: Unexpected error: <*errors.errorString | 0xc0002c3570>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30130 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30130 over TCP protocol occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithOptionalTransition(0xc0015afce0, 0x54075e0, 0xc002a56420, 0xc000e59440, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 +0x62e k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithTransition(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3466 k8s.io/kubernetes/test/e2e/network.glob..func24.30() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2541 +0xa5 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003541380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003541380, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 May 7 21:57:54.700: INFO: Cleaning up the exec pod STEP: deleting ReplicationController affinity-nodeport-transition in namespace services-8811, will wait for the garbage collector to delete the pods May 7 21:57:54.772: INFO: Deleting ReplicationController affinity-nodeport-transition took: 7.892542ms May 7 21:57:55.473: INFO: Terminating ReplicationController affinity-nodeport-transition pods took: 700.487219ms [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "services-8811". STEP: Found 31 events. May 7 21:58:05.292: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-4rd66: { } Scheduled: Successfully assigned services-8811/affinity-nodeport-transition-4rd66 to node1 May 7 21:58:05.293: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-dbcx4: { } Scheduled: Successfully assigned services-8811/affinity-nodeport-transition-dbcx4 to node2 May 7 21:58:05.293: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-vqpqz: { } Scheduled: Successfully assigned services-8811/affinity-nodeport-transition-vqpqz to node2 May 7 21:58:05.293: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod-affinity49g2t: { } Scheduled: Successfully assigned services-8811/execpod-affinity49g2t to node1 May 7 21:58:05.293: INFO: At 2021-05-07 21:55:42 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-vqpqz May 7 21:58:05.293: INFO: At 2021-05-07 21:55:42 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-4rd66 May 7 21:58:05.293: INFO: At 2021-05-07 21:55:42 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-dbcx4 May 7 21:58:05.293: INFO: At 2021-05-07 21:55:43 +0000 UTC - event for affinity-nodeport-transition-4rd66: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 7 21:58:05.293: INFO: At 2021-05-07 21:55:43 +0000 UTC - event for affinity-nodeport-transition-4rd66: {multus } AddedInterface: Add eth0 [10.244.3.201/24] May 7 21:58:05.293: INFO: At 2021-05-07 21:55:44 +0000 UTC - event for affinity-nodeport-transition-4rd66: {kubelet node1} Started: Started container affinity-nodeport-transition May 7 21:58:05.293: INFO: At 2021-05-07 21:55:44 +0000 UTC - event for affinity-nodeport-transition-4rd66: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 526.171901ms May 7 21:58:05.293: INFO: At 2021-05-07 21:55:44 +0000 UTC - event for affinity-nodeport-transition-4rd66: {kubelet node1} Created: Created container affinity-nodeport-transition May 7 21:58:05.293: INFO: At 2021-05-07 21:55:44 +0000 UTC - event for affinity-nodeport-transition-dbcx4: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 7 21:58:05.293: INFO: At 2021-05-07 21:55:44 +0000 UTC - event for affinity-nodeport-transition-dbcx4: {multus } AddedInterface: Add eth0 [10.244.4.249/24] May 7 21:58:05.293: INFO: At 2021-05-07 21:55:45 +0000 UTC - event for affinity-nodeport-transition-dbcx4: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 1.148449492s May 7 21:58:05.293: INFO: At 2021-05-07 21:55:45 +0000 UTC - event for affinity-nodeport-transition-dbcx4: {kubelet node2} Started: Started container affinity-nodeport-transition May 7 21:58:05.293: INFO: At 2021-05-07 21:55:45 +0000 UTC - event for affinity-nodeport-transition-dbcx4: {kubelet node2} Created: Created container affinity-nodeport-transition May 7 21:58:05.293: INFO: At 2021-05-07 21:55:45 +0000 UTC - event for affinity-nodeport-transition-vqpqz: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 7 21:58:05.293: INFO: At 2021-05-07 21:55:45 +0000 UTC - event for affinity-nodeport-transition-vqpqz: {multus } AddedInterface: Add eth0 [10.244.4.250/24] May 7 21:58:05.293: INFO: At 2021-05-07 21:55:46 +0000 UTC - event for affinity-nodeport-transition-vqpqz: {kubelet node2} Started: Started container affinity-nodeport-transition May 7 21:58:05.293: INFO: At 2021-05-07 21:55:46 +0000 UTC - event for affinity-nodeport-transition-vqpqz: {kubelet node2} Created: Created container affinity-nodeport-transition May 7 21:58:05.293: INFO: At 2021-05-07 21:55:46 +0000 UTC - event for affinity-nodeport-transition-vqpqz: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 921.82038ms May 7 21:58:05.293: INFO: At 2021-05-07 21:55:49 +0000 UTC - event for execpod-affinity49g2t: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 7 21:58:05.293: INFO: At 2021-05-07 21:55:49 +0000 UTC - event for execpod-affinity49g2t: {multus } AddedInterface: Add eth0 [10.244.3.202/24] May 7 21:58:05.293: INFO: At 2021-05-07 21:55:50 +0000 UTC - event for execpod-affinity49g2t: {kubelet node1} Started: Started container agnhost-container May 7 21:58:05.293: INFO: At 2021-05-07 21:55:50 +0000 UTC - event for execpod-affinity49g2t: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 669.434803ms May 7 21:58:05.293: INFO: At 2021-05-07 21:55:50 +0000 UTC - event for execpod-affinity49g2t: {kubelet node1} Created: Created container agnhost-container May 7 21:58:05.293: INFO: At 2021-05-07 21:57:54 +0000 UTC - event for execpod-affinity49g2t: {kubelet node1} Killing: Stopping container agnhost-container May 7 21:58:05.293: INFO: At 2021-05-07 21:57:55 +0000 UTC - event for affinity-nodeport-transition-4rd66: {kubelet node1} Killing: Stopping container affinity-nodeport-transition May 7 21:58:05.293: INFO: At 2021-05-07 21:57:55 +0000 UTC - event for affinity-nodeport-transition-dbcx4: {kubelet node2} Killing: Stopping container affinity-nodeport-transition May 7 21:58:05.293: INFO: At 2021-05-07 21:57:55 +0000 UTC - event for affinity-nodeport-transition-vqpqz: {kubelet node2} Killing: Stopping container affinity-nodeport-transition May 7 21:58:05.295: INFO: POD NODE PHASE GRACE CONDITIONS May 7 21:58:05.295: INFO: May 7 21:58:05.299: INFO: Logging node info for node master1 May 7 21:58:05.301: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 7277f528-99fb-4be3-a928-27761a4599e8 46195 0 2021-05-07 19:59:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a2:74:f5:d6:48:e4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 19:59:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 19:59:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-07 20:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:15 +0000 UTC,LastTransitionTime:2021-05-07 20:05:15 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:02 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:02 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:02 +0000 UTC,LastTransitionTime:2021-05-07 19:59:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:58:02 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:44253340a37b4ed7bf5b3a3547b5f57d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:2a44f9c3-2714-4b5c-975d-25d069f66483,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:58:05.302: INFO: Logging kubelet events for node master1 May 7 21:58:05.304: INFO: Logging pods the kubelet thinks is on node master1 May 7 21:58:05.314: INFO: kube-proxy-qpvcb started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.314: INFO: Container kube-proxy ready: true, restart count 2 May 7 21:58:05.314: INFO: kube-multus-ds-amd64-8tjh4 started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.314: INFO: Container kube-multus ready: true, restart count 1 May 7 21:58:05.314: INFO: docker-registry-docker-registry-56cbc7bc58-267wq started at 2021-05-07 20:05:51 +0000 UTC (0+2 container statuses recorded) May 7 21:58:05.314: INFO: Container docker-registry ready: true, restart count 0 May 7 21:58:05.314: INFO: Container nginx ready: true, restart count 0 May 7 21:58:05.314: INFO: prometheus-operator-5bb8cb9d8f-xqpnw started at 2021-05-07 20:12:35 +0000 UTC (0+2 container statuses recorded) May 7 21:58:05.314: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:05.314: INFO: Container prometheus-operator ready: true, restart count 0 May 7 21:58:05.314: INFO: coredns-7677f9bb54-wvd65 started at 2021-05-07 20:02:30 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.314: INFO: Container coredns ready: true, restart count 2 May 7 21:58:05.314: INFO: node-feature-discovery-controller-5bf5c49849-z2bj7 started at 2021-05-07 20:08:34 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.314: INFO: Container nfd-controller ready: true, restart count 0 May 7 21:58:05.314: INFO: node-exporter-9sm5v started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:58:05.314: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:05.314: INFO: Container node-exporter ready: true, restart count 0 May 7 21:58:05.314: INFO: kube-apiserver-master1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.314: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:58:05.314: INFO: kube-controller-manager-master1 started at 2021-05-07 20:04:26 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.314: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:58:05.314: INFO: kube-scheduler-master1 started at 2021-05-07 20:15:37 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.314: INFO: Container kube-scheduler ready: true, restart count 0 May 7 21:58:05.314: INFO: kube-flannel-nj6vr started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:58:05.314: INFO: Init container install-cni ready: true, restart count 0 May 7 21:58:05.314: INFO: Container kube-flannel ready: true, restart count 2 W0507 21:58:05.327657 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:58:05.353: INFO: Latency metrics for node master1 May 7 21:58:05.353: INFO: Logging node info for node master2 May 7 21:58:05.355: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 8193aa97-7914-4d63-b6cf-a7ceb8fe519c 46172 0 2021-05-07 20:00:06 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:88:6a:bc:18:32"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-05-07 20:01:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:58 +0000 UTC,LastTransitionTime:2021-05-07 20:04:58 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:57:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:57:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:57:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:57:58 +0000 UTC,LastTransitionTime:2021-05-07 20:02:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:cf652b4fb7284de2aaafc5f52f51e312,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:df4da196-5a1c-4b40-aef7-034e79f7a8e2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:58:05.356: INFO: Logging kubelet events for node master2 May 7 21:58:05.358: INFO: Logging pods the kubelet thinks is on node master2 May 7 21:58:05.367: INFO: kube-flannel-wwlww started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:58:05.367: INFO: Init container install-cni ready: true, restart count 0 May 7 21:58:05.367: INFO: Container kube-flannel ready: true, restart count 1 May 7 21:58:05.367: INFO: kube-multus-ds-amd64-44vrh started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.367: INFO: Container kube-multus ready: true, restart count 1 May 7 21:58:05.367: INFO: dns-autoscaler-5b7b5c9b6f-flqh2 started at 2021-05-07 20:02:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.367: INFO: Container autoscaler ready: true, restart count 2 May 7 21:58:05.367: INFO: node-exporter-6nqvj started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:58:05.367: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:05.367: INFO: Container node-exporter ready: true, restart count 0 May 7 21:58:05.367: INFO: kube-apiserver-master2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.367: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:58:05.367: INFO: kube-controller-manager-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.367: INFO: Container kube-controller-manager ready: true, restart count 2 May 7 21:58:05.367: INFO: kube-scheduler-master2 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.367: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:58:05.367: INFO: kube-proxy-fg5dt started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.367: INFO: Container kube-proxy ready: true, restart count 1 W0507 21:58:05.380552 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:58:05.409: INFO: Latency metrics for node master2 May 7 21:58:05.409: INFO: Logging node info for node master3 May 7 21:58:05.411: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 27e1bfdf-bb8c-4924-9488-acacef172e76 46170 0 2021-05-07 20:00:17 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"de:31:a8:23:73:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-07 20:00:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-07 20:00:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-07 20:02:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:04:10 +0000 UTC,LastTransitionTime:2021-05-07 20:04:10 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:57:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:57:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:57:58 +0000 UTC,LastTransitionTime:2021-05-07 20:00:17 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:57:58 +0000 UTC,LastTransitionTime:2021-05-07 20:03:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:01ba71adbf0d4ef79a9af064c18faf21,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:1692e58d-c13c-425c-b11a-62d901f965ec,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:58:05.412: INFO: Logging kubelet events for node master3 May 7 21:58:05.414: INFO: Logging pods the kubelet thinks is on node master3 May 7 21:58:05.425: INFO: coredns-7677f9bb54-pj7xl started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.425: INFO: Container coredns ready: true, restart count 2 May 7 21:58:05.425: INFO: node-exporter-tsk7w started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:58:05.425: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:05.425: INFO: Container node-exporter ready: true, restart count 0 May 7 21:58:05.425: INFO: kube-apiserver-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.425: INFO: Container kube-apiserver ready: true, restart count 0 May 7 21:58:05.425: INFO: kube-controller-manager-master3 started at 2021-05-07 20:03:45 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.425: INFO: Container kube-controller-manager ready: true, restart count 3 May 7 21:58:05.425: INFO: kube-scheduler-master3 started at 2021-05-07 20:00:42 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.425: INFO: Container kube-scheduler ready: true, restart count 2 May 7 21:58:05.425: INFO: kube-proxy-lvj72 started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.425: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:58:05.425: INFO: kube-flannel-j2xn4 started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:58:05.425: INFO: Init container install-cni ready: true, restart count 1 May 7 21:58:05.425: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:58:05.425: INFO: kube-multus-ds-amd64-hhqgw started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.425: INFO: Container kube-multus ready: true, restart count 1 W0507 21:58:05.439028 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:58:05.463: INFO: Latency metrics for node master3 May 7 21:58:05.463: INFO: Logging node info for node node1 May 7 21:58:05.466: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 24d047f7-eb29-4f1d-96d0-63b225220bd5 46194 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"da:1d:6f:d2:a8:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:03:55 +0000 UTC,LastTransitionTime:2021-05-07 20:03:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:01 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:01 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:01 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:58:01 +0000 UTC,LastTransitionTime:2021-05-07 20:03:44 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d79c3a817fbd4f03a173930e545bb174,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:53771151-d654-4c88-80fe-48032d3317a5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002488002,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:58:05.467: INFO: Logging kubelet events for node node1 May 7 21:58:05.468: INFO: Logging pods the kubelet thinks is on node node1 May 7 21:58:05.483: INFO: webserver-deployment-dd94f59b7-lkk66 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container httpd ready: false, restart count 0 May 7 21:58:05.484: INFO: webserver-deployment-dd94f59b7-54hd5 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container httpd ready: false, restart count 0 May 7 21:58:05.484: INFO: cmk-gjhf2 started at 2021-05-07 20:11:48 +0000 UTC (0+2 container statuses recorded) May 7 21:58:05.484: INFO: Container nodereport ready: true, restart count 0 May 7 21:58:05.484: INFO: Container reconcile ready: true, restart count 0 May 7 21:58:05.484: INFO: prometheus-k8s-0 started at 2021-05-07 20:12:50 +0000 UTC (0+5 container statuses recorded) May 7 21:58:05.484: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 7 21:58:05.484: INFO: Container grafana ready: true, restart count 0 May 7 21:58:05.484: INFO: Container prometheus ready: true, restart count 1 May 7 21:58:05.484: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 7 21:58:05.484: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 7 21:58:05.484: INFO: webserver-deployment-dd94f59b7-rvv98 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container httpd ready: false, restart count 0 May 7 21:58:05.484: INFO: kube-multus-ds-amd64-fxgdb started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container kube-multus ready: true, restart count 1 May 7 21:58:05.484: INFO: kube-flannel-qm7lv started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:58:05.484: INFO: Init container install-cni ready: true, restart count 2 May 7 21:58:05.484: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:58:05.484: INFO: kubernetes-metrics-scraper-678c97765c-g7srv started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 7 21:58:05.484: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-mq752 started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:58:05.484: INFO: node-exporter-mpq58 started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:58:05.484: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:05.484: INFO: Container node-exporter ready: true, restart count 0 May 7 21:58:05.484: INFO: collectd-tmjfs started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:58:05.484: INFO: Container collectd ready: true, restart count 0 May 7 21:58:05.484: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:58:05.484: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:58:05.484: INFO: ss-0 started at 2021-05-07 21:49:46 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container webserver ready: false, restart count 0 May 7 21:58:05.484: INFO: pod-configmaps-492a36ce-a6ac-401e-9fb5-5e28913c3fd4 started at 2021-05-07 21:54:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container env-test ready: false, restart count 0 May 7 21:58:05.484: INFO: nginx-proxy-node1 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container nginx-proxy ready: true, restart count 1 May 7 21:58:05.484: INFO: foo-ln5vh started at 2021-05-07 21:55:35 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container c ready: false, restart count 0 May 7 21:58:05.484: INFO: webserver-deployment-dd94f59b7-gnnrp started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container httpd ready: false, restart count 0 May 7 21:58:05.484: INFO: node-feature-discovery-worker-xvbpd started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:58:05.484: INFO: cmk-init-discover-node1-krbjn started at 2021-05-07 20:11:05 +0000 UTC (0+3 container statuses recorded) May 7 21:58:05.484: INFO: Container discover ready: false, restart count 0 May 7 21:58:05.484: INFO: Container init ready: false, restart count 0 May 7 21:58:05.484: INFO: Container install ready: false, restart count 0 May 7 21:58:05.484: INFO: webserver-deployment-dd94f59b7-7xggp started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container httpd ready: false, restart count 0 May 7 21:58:05.484: INFO: kube-proxy-bms7z started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.484: INFO: Container kube-proxy ready: true, restart count 2 W0507 21:58:05.497315 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:58:05.539: INFO: Latency metrics for node node1 May 7 21:58:05.539: INFO: Logging node info for node node2 May 7 21:58:05.542: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eae422ac-f6f0-4e9a-961d-e133dffc36be 46193 0 2021-05-07 20:01:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:df:da:84:9b:00"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-07 20:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-07 20:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-07 20:08:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-07 20:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-07 20:11:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-07 20:05:02 +0000 UTC,LastTransitionTime:2021-05-07 20:05:02 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:01 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:01 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-07 21:58:01 +0000 UTC,LastTransitionTime:2021-05-07 20:01:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-07 21:58:01 +0000 UTC,LastTransitionTime:2021-05-07 20:02:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:6f56c5a750d0441dba0ffa6273fb1a17,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:98b263e9-3136-45ed-9b07-5f5b6b9d69b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:facbba279b626f9254dfef1616802a1eadebffadd9d37bde82b5562163121c72 localhost:30500/barometer-collectd:stable],SizeBytes:1464089363,},ContainerImage{Names:[localhost:30500/cmk@sha256:9955df6c40f7a908013f9d77afdcd5df3df7f47ffb0eb09bbcb27d61112121ec localhost:30500/cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726657349,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:75a55d33ecc73c2a242450a9f1cc858499d468f077ea942867e662c247b5e412 nginx:1.19],SizeBytes:133117205,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:bae53f2ec899d23f9342d730c376a1ee3805e96fd1e5e4857e65085e6529557d localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392820,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:09461cf1b75776eb7d277a89d3a624c9eea355bf2ab1d8abbe45c40df99de268 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:5b4ebd3c9985a2f36839e18a8b7c84e4d1deb89fa486247108510c71673efe12 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 7 21:58:05.542: INFO: Logging kubelet events for node node2 May 7 21:58:05.544: INFO: Logging pods the kubelet thinks is on node node2 May 7 21:58:05.561: INFO: cmk-gvh7j started at 2021-05-07 20:11:49 +0000 UTC (0+2 container statuses recorded) May 7 21:58:05.561: INFO: Container nodereport ready: true, restart count 0 May 7 21:58:05.561: INFO: Container reconcile ready: true, restart count 0 May 7 21:58:05.561: INFO: kubernetes-dashboard-86c6f9df5b-k9cj2 started at 2021-05-07 20:02:35 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.561: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 7 21:58:05.561: INFO: cmk-init-discover-node2-kd9gg started at 2021-05-07 20:11:26 +0000 UTC (0+3 container statuses recorded) May 7 21:58:05.561: INFO: Container discover ready: false, restart count 0 May 7 21:58:05.561: INFO: Container init ready: false, restart count 0 May 7 21:58:05.561: INFO: Container install ready: false, restart count 0 May 7 21:58:05.561: INFO: webserver-deployment-dd94f59b7-wgwgb started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.561: INFO: Container httpd ready: false, restart count 0 May 7 21:58:05.561: INFO: cmk-webhook-6c9d5f8578-94s58 started at 2021-05-07 20:11:49 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.561: INFO: Container cmk-webhook ready: true, restart count 0 May 7 21:58:05.561: INFO: collectd-p5gbt started at 2021-05-07 20:18:33 +0000 UTC (0+3 container statuses recorded) May 7 21:58:05.561: INFO: Container collectd ready: true, restart count 0 May 7 21:58:05.561: INFO: Container collectd-exporter ready: true, restart count 0 May 7 21:58:05.561: INFO: Container rbac-proxy ready: true, restart count 0 May 7 21:58:05.561: INFO: webserver-deployment-dd94f59b7-hbp9l started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.561: INFO: Container httpd ready: false, restart count 0 May 7 21:58:05.561: INFO: nginx-proxy-node2 started at 2021-05-07 20:07:46 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.561: INFO: Container nginx-proxy ready: true, restart count 2 May 7 21:58:05.561: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-tkw8z started at 2021-05-07 20:09:23 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.561: INFO: Container kube-sriovdp ready: true, restart count 0 May 7 21:58:05.561: INFO: foo-jwlrh started at 2021-05-07 21:55:35 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.561: INFO: Container c ready: false, restart count 0 May 7 21:58:05.561: INFO: kube-proxy-rgw7h started at 2021-05-07 20:01:27 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.561: INFO: Container kube-proxy ready: true, restart count 1 May 7 21:58:05.561: INFO: node-feature-discovery-worker-wp5n6 started at 2021-05-07 20:08:19 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.561: INFO: Container nfd-worker ready: true, restart count 0 May 7 21:58:05.561: INFO: node-exporter-4bcls started at 2021-05-07 20:12:42 +0000 UTC (0+2 container statuses recorded) May 7 21:58:05.561: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 7 21:58:05.562: INFO: Container node-exporter ready: true, restart count 0 May 7 21:58:05.562: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8z46f started at 2021-05-07 20:15:36 +0000 UTC (0+2 container statuses recorded) May 7 21:58:05.562: INFO: Container tas-controller ready: true, restart count 0 May 7 21:58:05.562: INFO: Container tas-extender ready: true, restart count 0 May 7 21:58:05.562: INFO: webserver-deployment-dd94f59b7-7d7h2 started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.562: INFO: Container httpd ready: false, restart count 0 May 7 21:58:05.562: INFO: webserver-deployment-dd94f59b7-rqdcf started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.562: INFO: Container httpd ready: false, restart count 0 May 7 21:58:05.562: INFO: kube-flannel-htqkx started at 2021-05-07 20:02:02 +0000 UTC (1+1 container statuses recorded) May 7 21:58:05.562: INFO: Init container install-cni ready: true, restart count 2 May 7 21:58:05.562: INFO: Container kube-flannel ready: true, restart count 2 May 7 21:58:05.562: INFO: kube-multus-ds-amd64-g98hm started at 2021-05-07 20:02:10 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.562: INFO: Container kube-multus ready: true, restart count 1 May 7 21:58:05.562: INFO: busybox-host-aliasesa735d79b-e791-4100-b1f8-245b814cd445 started at 2021-05-07 21:53:16 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.562: INFO: Container busybox-host-aliasesa735d79b-e791-4100-b1f8-245b814cd445 ready: false, restart count 0 May 7 21:58:05.562: INFO: webserver-deployment-dd94f59b7-smk7q started at 2021-05-07 21:53:33 +0000 UTC (0+1 container statuses recorded) May 7 21:58:05.562: INFO: Container httpd ready: false, restart count 0 W0507 21:58:05.573964 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 7 21:58:05.616: INFO: Latency metrics for node node2 May 7 21:58:05.616: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-8811" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786