/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 27 23:46:41.229: Unexpected error: <*errors.errorString | 0xc004b42e80>: { s: "expected pod \"var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01\" success: Gave up after waiting 5m0s for pod \"var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01" success: Gave up after waiting 5m0s for pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 27 23:41:36.607: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should allow substituting values in a volume subpath [sig-storage] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test substitution in volume subpath Aug 27 23:41:36.641: INFO: Waiting up to 5m0s for pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01" in namespace "var-expansion-9530" to be "Succeeded or Failed" Aug 27 23:41:36.644: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2.749646ms Aug 27 23:41:38.648: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006859335s Aug 27 23:41:40.651: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4.010076982s Aug 27 23:41:42.655: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013880383s Aug 27 23:41:44.660: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 8.018525688s Aug 27 23:41:46.664: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 10.022379864s Aug 27 23:41:48.667: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 12.025935273s Aug 27 23:41:50.670: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 14.028581661s Aug 27 23:41:52.674: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 16.032456315s Aug 27 23:41:54.677: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 18.035574029s Aug 27 23:41:56.681: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 20.039738649s Aug 27 23:41:58.686: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 22.044896777s Aug 27 23:42:00.691: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 24.049614957s Aug 27 23:42:02.694: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 26.053308125s Aug 27 23:42:04.697: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 28.056194842s Aug 27 23:42:06.701: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 30.059989978s Aug 27 23:42:08.704: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 32.062384519s Aug 27 23:42:10.707: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 34.065439323s Aug 27 23:42:12.711: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 36.069755765s Aug 27 23:42:14.715: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 38.073541321s Aug 27 23:42:16.718: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 40.076894376s Aug 27 23:42:18.724: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 42.082420239s Aug 27 23:42:20.727: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 44.085557896s Aug 27 23:42:22.730: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 46.08896664s Aug 27 23:42:24.734: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 48.093180989s Aug 27 23:42:26.738: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 50.096809832s Aug 27 23:42:28.741: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 52.100164869s Aug 27 23:42:30.744: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 54.103370236s Aug 27 23:42:32.749: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 56.108125053s Aug 27 23:42:34.754: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 58.11248131s Aug 27 23:42:36.759: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.117419783s Aug 27 23:42:38.763: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.12179901s Aug 27 23:42:40.767: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.125521033s Aug 27 23:42:42.771: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.129541231s Aug 27 23:42:44.775: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.133642966s Aug 27 23:42:46.777: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.136298496s Aug 27 23:42:48.782: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.140771328s Aug 27 23:42:50.786: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.144896238s Aug 27 23:42:52.789: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.147499798s Aug 27 23:42:54.793: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.151958396s Aug 27 23:42:56.797: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.155742886s Aug 27 23:42:58.800: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.158639317s Aug 27 23:43:00.803: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.162076215s Aug 27 23:43:02.807: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.166076455s Aug 27 23:43:04.811: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.169947735s Aug 27 23:43:06.814: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.173178562s Aug 27 23:43:08.819: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.178111086s Aug 27 23:43:10.823: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.182014394s Aug 27 23:43:12.827: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.185618746s Aug 27 23:43:14.830: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.189305548s Aug 27 23:43:16.834: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.192386222s Aug 27 23:43:18.837: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.195496147s Aug 27 23:43:20.841: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.199820082s Aug 27 23:43:22.845: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.20417593s Aug 27 23:43:24.850: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.209129965s Aug 27 23:43:26.854: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.212455028s Aug 27 23:43:28.857: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.216135988s Aug 27 23:43:30.861: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.219680677s Aug 27 23:43:32.864: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.223060882s Aug 27 23:43:34.868: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.227062964s Aug 27 23:43:36.871: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.229947701s Aug 27 23:43:38.874: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.232797567s Aug 27 23:43:40.878: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.236503084s Aug 27 23:43:42.881: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.240188336s Aug 27 23:43:44.885: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.2442913s Aug 27 23:43:46.888: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.247128658s Aug 27 23:43:48.892: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.251000068s Aug 27 23:43:50.895: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.254226037s Aug 27 23:43:52.898: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.257121954s Aug 27 23:43:54.902: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.260626688s Aug 27 23:43:56.904: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.263296774s Aug 27 23:43:58.909: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.26769627s Aug 27 23:44:00.911: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.270333353s Aug 27 23:44:02.915: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.273768949s Aug 27 23:44:04.918: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.27723399s Aug 27 23:44:06.921: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.279794616s Aug 27 23:44:08.924: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.282748621s Aug 27 23:44:10.927: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.286311719s Aug 27 23:44:12.932: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.290644348s Aug 27 23:44:14.936: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.295280618s Aug 27 23:44:16.940: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.298414621s Aug 27 23:44:18.944: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.302408517s Aug 27 23:44:20.947: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.305815309s Aug 27 23:44:22.951: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.309945563s Aug 27 23:44:24.955: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.313750127s Aug 27 23:44:26.957: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.3161985s Aug 27 23:44:28.960: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.319210326s Aug 27 23:44:30.963: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.321703533s Aug 27 23:44:32.967: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.326115624s Aug 27 23:44:34.972: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.330483758s Aug 27 23:44:36.974: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.333355397s Aug 27 23:44:38.978: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.337223908s Aug 27 23:44:40.982: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.340966832s Aug 27 23:44:42.986: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.344999083s Aug 27 23:44:44.993: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.352327761s Aug 27 23:44:46.996: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.35506609s Aug 27 23:44:48.999: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.358242039s Aug 27 23:44:51.002: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.361232234s Aug 27 23:44:53.007: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.365566983s Aug 27 23:44:55.013: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.372127372s Aug 27 23:44:57.016: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.375256814s Aug 27 23:44:59.023: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.381749863s Aug 27 23:45:01.025: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.384221617s Aug 27 23:45:03.028: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.38668458s Aug 27 23:45:05.030: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.389046375s Aug 27 23:45:07.034: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.392650945s Aug 27 23:45:09.038: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.396696326s Aug 27 23:45:11.041: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.399641666s Aug 27 23:45:13.044: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.403239251s Aug 27 23:45:15.048: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.406782241s Aug 27 23:45:17.051: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.410310047s Aug 27 23:45:19.054: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.413303365s Aug 27 23:45:21.057: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.415734051s Aug 27 23:45:23.060: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.419054881s Aug 27 23:45:25.064: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.42284759s Aug 27 23:45:27.067: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.425549049s Aug 27 23:45:29.072: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.431358305s Aug 27 23:45:31.077: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.43556466s Aug 27 23:45:33.080: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.43918233s Aug 27 23:45:35.084: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.442523066s Aug 27 23:45:37.087: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.445580618s Aug 27 23:45:39.090: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.449062071s Aug 27 23:45:41.093: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.451962149s Aug 27 23:45:43.096: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.454630869s Aug 27 23:45:45.099: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.4576551s Aug 27 23:45:47.101: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.460283192s Aug 27 23:45:49.104: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.462832439s Aug 27 23:45:51.107: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.465569036s Aug 27 23:45:53.109: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.468238999s Aug 27 23:45:55.114: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.472776806s Aug 27 23:45:57.117: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.47540861s Aug 27 23:45:59.124: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.482992943s Aug 27 23:46:01.128: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.486406792s Aug 27 23:46:03.133: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.491658443s Aug 27 23:46:05.138: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.497286827s Aug 27 23:46:07.142: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.501232369s Aug 27 23:46:09.147: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.50626738s Aug 27 23:46:11.152: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.510387366s Aug 27 23:46:13.155: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.514154479s Aug 27 23:46:15.159: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.518021963s Aug 27 23:46:17.164: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.522658421s Aug 27 23:46:19.171: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.529432134s Aug 27 23:46:21.175: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.534066287s Aug 27 23:46:23.179: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.537551662s Aug 27 23:46:25.183: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.541450012s Aug 27 23:46:27.186: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.544668641s Aug 27 23:46:29.191: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.549528743s Aug 27 23:46:31.194: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.553368769s Aug 27 23:46:33.199: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.557940039s Aug 27 23:46:35.206: INFO: Pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.565218607s Aug 27 23:46:37.215: INFO: Failed to get logs from node "node1" pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01" container "dapi-container": the server rejected our request for an unknown reason (get pods var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01) STEP: delete the pod Aug 27 23:46:37.221: INFO: Waiting for pod var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01 to disappear Aug 27 23:46:37.223: INFO: Pod var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01 still exists Aug 27 23:46:39.227: INFO: Waiting for pod var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01 to disappear Aug 27 23:46:39.230: INFO: Pod var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01 still exists Aug 27 23:46:41.224: INFO: Waiting for pod var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01 to disappear Aug 27 23:46:41.228: INFO: Pod var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01 no longer exists Aug 27 23:46:41.229: FAIL: Unexpected error: <*errors.errorString | 0xc004b42e80>: { s: "expected pod \"var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01\" success: Gave up after waiting 5m0s for pod \"var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01" success: Gave up after waiting 5m0s for pod "var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00106b760, 0x4c6cdb8, 0x1e, 0xc005016000, 0x0, 0xc003d7d1c8, 0x1, 0x1, 0x4df0110) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func9.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:139 +0x35a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0018a1e00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0018a1e00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0018a1e00, 0x4dec428) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-9530". STEP: Found 9 events. Aug 27 23:46:41.233: INFO: At 2021-08-27 23:41:36 +0000 UTC - event for var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01: {default-scheduler } Scheduled: Successfully assigned var-expansion-9530/var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01 to node1 Aug 27 23:46:41.233: INFO: At 2021-08-27 23:41:38 +0000 UTC - event for var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01: {multus } AddedInterface: Add eth0 [10.244.3.243/24] Aug 27 23:46:41.233: INFO: At 2021-08-27 23:41:38 +0000 UTC - event for var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 27 23:46:41.233: INFO: At 2021-08-27 23:41:39 +0000 UTC - event for var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 27 23:46:41.233: INFO: At 2021-08-27 23:41:39 +0000 UTC - event for var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01: {kubelet node1} Failed: Error: ErrImagePull Aug 27 23:46:41.233: INFO: At 2021-08-27 23:41:39 +0000 UTC - event for var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 27 23:46:41.233: INFO: At 2021-08-27 23:41:40 +0000 UTC - event for var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01: {multus } AddedInterface: Add eth0 [10.244.3.244/24] Aug 27 23:46:41.233: INFO: At 2021-08-27 23:41:40 +0000 UTC - event for var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 27 23:46:41.233: INFO: At 2021-08-27 23:41:40 +0000 UTC - event for var-expansion-5cb4d930-ff54-47be-a198-6adb16e9fa01: {kubelet node1} Failed: Error: ImagePullBackOff Aug 27 23:46:41.235: INFO: POD NODE PHASE GRACE CONDITIONS Aug 27 23:46:41.235: INFO: Aug 27 23:46:41.240: INFO: Logging node info for node master1 Aug 27 23:46:41.243: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 3af53387-5aee-42c1-b0e7-644cf9161d48 59289 0 2021-08-27 20:46:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"92:f8:b6:72:e4:be"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-27 20:46:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-27 20:46:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-08-27 20:46:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:50:56 +0000 UTC,LastTransitionTime:2021-08-27 20:50:56 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:39 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:39 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:39 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-27 23:46:39 +0000 UTC,LastTransitionTime:2021-08-27 20:50:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5d584023135a46ecb77596bf48ed7f2f,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:587cafa0-6de3-49f8-906e-06315a8ff104,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:ae72171f047a37ee5423e0692df7429830919af16e9d668ab0c80b723863d102 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:cd98d1edca8e5e2e3ea42cbc463812483e5d069d10f0974ca9d484b5a7bd68db tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 27 23:46:41.243: INFO: Logging kubelet events for node master1 Aug 27 23:46:41.246: INFO: Logging pods the kubelet thinks is on node master1 Aug 27 23:46:41.266: INFO: kube-apiserver-master1 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.266: INFO: Container kube-apiserver ready: true, restart count 0 Aug 27 23:46:41.266: INFO: kube-controller-manager-master1 started at 2021-08-27 20:54:27 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.266: INFO: Container kube-controller-manager ready: true, restart count 3 Aug 27 23:46:41.266: INFO: kube-proxy-rb5p6 started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.266: INFO: Container kube-proxy ready: true, restart count 1 Aug 27 23:46:41.266: INFO: coredns-7677f9bb54-dwtp5 started at 2021-08-27 20:49:16 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.266: INFO: Container coredns ready: true, restart count 1 Aug 27 23:46:41.266: INFO: node-exporter-z2ngr started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 27 23:46:41.266: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:46:41.266: INFO: Container node-exporter ready: true, restart count 0 Aug 27 23:46:41.266: INFO: kube-scheduler-master1 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.266: INFO: Container kube-scheduler ready: true, restart count 0 Aug 27 23:46:41.266: INFO: kube-flannel-pp7vp started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 27 23:46:41.266: INFO: Init container install-cni ready: true, restart count 0 Aug 27 23:46:41.266: INFO: Container kube-flannel ready: true, restart count 3 Aug 27 23:46:41.266: INFO: kube-multus-ds-amd64-sfr9k started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.266: INFO: Container kube-multus ready: true, restart count 1 Aug 27 23:46:41.266: INFO: docker-registry-docker-registry-56cbc7bc58-cthtt started at 2021-08-27 20:51:47 +0000 UTC (0+2 container statuses recorded) Aug 27 23:46:41.266: INFO: Container docker-registry ready: true, restart count 0 Aug 27 23:46:41.266: INFO: Container nginx ready: true, restart count 0 W0827 23:46:41.279265 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 27 23:46:41.303: INFO: Latency metrics for node master1 Aug 27 23:46:41.303: INFO: Logging node info for node master2 Aug 27 23:46:41.306: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 666e473f-d9e6-4c06-8b56-06474d788f70 59267 0 2021-08-27 20:46:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"42:86:ff:30:bd:4d"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-27 20:46:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-27 20:46:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-27 20:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:53 +0000 UTC,LastTransitionTime:2021-08-27 20:51:53 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2835065974a64998811b9acd85de209b,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:309b9155-1e2a-4ebd-900f-bba5abfc3a5d,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 27 23:46:41.307: INFO: Logging kubelet events for node master2 Aug 27 23:46:41.309: INFO: Logging pods the kubelet thinks is on node master2 Aug 27 23:46:41.317: INFO: kube-apiserver-master2 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.317: INFO: Container kube-apiserver ready: true, restart count 0 Aug 27 23:46:41.317: INFO: kube-scheduler-master2 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.317: INFO: Container kube-scheduler ready: true, restart count 2 Aug 27 23:46:41.317: INFO: kube-proxy-b4mn9 started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.317: INFO: Container kube-proxy ready: true, restart count 1 Aug 27 23:46:41.317: INFO: node-feature-discovery-controller-5bf5c49849-zr9zd started at 2021-08-27 20:55:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.317: INFO: Container nfd-controller ready: true, restart count 0 Aug 27 23:46:41.317: INFO: kube-controller-manager-master2 started at 2021-08-27 20:51:01 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.317: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 27 23:46:41.317: INFO: kube-flannel-4znnq started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 27 23:46:41.318: INFO: Init container install-cni ready: true, restart count 2 Aug 27 23:46:41.318: INFO: Container kube-flannel ready: true, restart count 2 Aug 27 23:46:41.318: INFO: kube-multus-ds-amd64-4mgbk started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.318: INFO: Container kube-multus ready: true, restart count 1 Aug 27 23:46:41.318: INFO: prometheus-operator-5bb8cb9d8f-whr5p started at 2021-08-27 20:59:06 +0000 UTC (0+2 container statuses recorded) Aug 27 23:46:41.318: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:46:41.318: INFO: Container prometheus-operator ready: true, restart count 0 Aug 27 23:46:41.318: INFO: node-exporter-96jk5 started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 27 23:46:41.318: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:46:41.318: INFO: Container node-exporter ready: true, restart count 0 W0827 23:46:41.329239 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 27 23:46:41.358: INFO: Latency metrics for node master2 Aug 27 23:46:41.358: INFO: Logging node info for node master3 Aug 27 23:46:41.361: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 620b6dba-f2c5-46e9-b2ff-d2f4197167d0 59258 0 2021-08-27 20:47:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ce:de:ea:c3:40:4f"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-27 20:47:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-27 20:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-27 20:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:44 +0000 UTC,LastTransitionTime:2021-08-27 20:51:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:35 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:35 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:35 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-27 23:46:35 +0000 UTC,LastTransitionTime:2021-08-27 20:48:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:37decbffe0e84048b5801289ad3be5bf,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:c96fe8b9-1ce0-44cd-935a-b58987e26570,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496891,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 27 23:46:41.362: INFO: Logging kubelet events for node master3 Aug 27 23:46:41.364: INFO: Logging pods the kubelet thinks is on node master3 Aug 27 23:46:41.372: INFO: kube-controller-manager-master3 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.373: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 27 23:46:41.373: INFO: kube-proxy-8sxhm started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.373: INFO: Container kube-proxy ready: true, restart count 1 Aug 27 23:46:41.373: INFO: kube-flannel-fkz5d started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 27 23:46:41.373: INFO: Init container install-cni ready: true, restart count 0 Aug 27 23:46:41.373: INFO: Container kube-flannel ready: true, restart count 1 Aug 27 23:46:41.373: INFO: dns-autoscaler-5b7b5c9b6f-54xch started at 2021-08-27 20:49:19 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.373: INFO: Container autoscaler ready: true, restart count 1 Aug 27 23:46:41.373: INFO: coredns-7677f9bb54-rxplt started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.373: INFO: Container coredns ready: true, restart count 1 Aug 27 23:46:41.373: INFO: kube-apiserver-master3 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.373: INFO: Container kube-apiserver ready: true, restart count 0 Aug 27 23:46:41.373: INFO: kube-scheduler-master3 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.373: INFO: Container kube-scheduler ready: true, restart count 2 Aug 27 23:46:41.373: INFO: kube-multus-ds-amd64-wwcgv started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.373: INFO: Container kube-multus ready: true, restart count 1 Aug 27 23:46:41.373: INFO: node-exporter-d4m7q started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 27 23:46:41.373: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:46:41.373: INFO: Container node-exporter ready: true, restart count 0 W0827 23:46:41.385743 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 27 23:46:41.418: INFO: Latency metrics for node master3 Aug 27 23:46:41.418: INFO: Logging node info for node node1 Aug 27 23:46:41.421: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 e7a2481e-32db-4c83-bd9f-4a0687258e7a 59266 0 2021-08-27 20:48:09 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"56:c7:37:40:51:ca"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-27 20:48:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-27 20:48:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-27 20:57:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-27 20:57:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:49 +0000 UTC,LastTransitionTime:2021-08-27 20:51:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c1e38e80ea114a5f96601202301ce842,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:e769e86d-15c0-442c-a93b-bcc6c33ff1cd,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:331c6faa8b0d5ec72cf105e87d35df0a2f2baeec3d6217a51faa73f9460f937f localhost:30500/barometer-collectd:stable],SizeBytes:1238704157,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1003787960,},ContainerImage{Names:[localhost:30500/cmk@sha256:fd1487b0c07556a087eff669e70c501a704720dcd53ff75183593de6720585f2 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:d7300ccf7ff3e9cea2111d275143b8050618bbc1d1ffe41f46286b1696261243 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44393508,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 27 23:46:41.421: INFO: Logging kubelet events for node node1 Aug 27 23:46:41.424: INFO: Logging pods the kubelet thinks is on node node1 Aug 27 23:46:41.440: INFO: node-feature-discovery-worker-bd9kg started at 2021-08-27 20:55:06 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Container nfd-worker ready: true, restart count 0 Aug 27 23:46:41.440: INFO: kubernetes-dashboard-86c6f9df5b-c56fg started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Container kubernetes-dashboard ready: true, restart count 1 Aug 27 23:46:41.440: INFO: collectd-ccvwg started at 2021-08-27 21:04:15 +0000 UTC (0+3 container statuses recorded) Aug 27 23:46:41.440: INFO: Container collectd ready: true, restart count 0 Aug 27 23:46:41.440: INFO: Container collectd-exporter ready: true, restart count 0 Aug 27 23:46:41.440: INFO: Container rbac-proxy ready: true, restart count 0 Aug 27 23:46:41.440: INFO: ss2-1 started at 2021-08-27 23:39:37 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Container webserver ready: true, restart count 0 Aug 27 23:46:41.440: INFO: downwardapi-volume-165fb1c2-5a0e-496a-a4c2-00c31be85029 started at 2021-08-27 23:46:37 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Container client-container ready: false, restart count 0 Aug 27 23:46:41.440: INFO: kube-proxy-pb5bl started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Container kube-proxy ready: true, restart count 2 Aug 27 23:46:41.440: INFO: prometheus-k8s-0 started at 2021-08-27 20:59:29 +0000 UTC (0+5 container statuses recorded) Aug 27 23:46:41.440: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 27 23:46:41.440: INFO: Container grafana ready: true, restart count 0 Aug 27 23:46:41.440: INFO: Container prometheus ready: true, restart count 1 Aug 27 23:46:41.440: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 27 23:46:41.440: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 27 23:46:41.440: INFO: pod-qos-class-84c512ab-e22b-4ee0-a2e2-29af708b4de0 started at 2021-08-27 23:45:13 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Container agnhost ready: true, restart count 0 Aug 27 23:46:41.440: INFO: kube-flannel-ssxn7 started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Init container install-cni ready: true, restart count 0 Aug 27 23:46:41.440: INFO: Container kube-flannel ready: true, restart count 1 Aug 27 23:46:41.440: INFO: kubernetes-metrics-scraper-678c97765c-gtp5x started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 Aug 27 23:46:41.440: INFO: cmk-init-discover-node1-spg26 started at 2021-08-27 20:57:37 +0000 UTC (0+3 container statuses recorded) Aug 27 23:46:41.440: INFO: Container discover ready: false, restart count 0 Aug 27 23:46:41.440: INFO: Container init ready: false, restart count 0 Aug 27 23:46:41.440: INFO: Container install ready: false, restart count 0 Aug 27 23:46:41.440: INFO: cmk-jw4m6 started at 2021-08-27 20:58:19 +0000 UTC (0+2 container statuses recorded) Aug 27 23:46:41.440: INFO: Container nodereport ready: true, restart count 0 Aug 27 23:46:41.440: INFO: Container reconcile ready: true, restart count 0 Aug 27 23:46:41.440: INFO: kube-multus-ds-amd64-nn7bl started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Container kube-multus ready: true, restart count 1 Aug 27 23:46:41.440: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-9lndx started at 2021-08-27 20:55:51 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 27 23:46:41.440: INFO: pod-init-0f2a9f46-6fd7-4394-8340-4707adea2272 started at 2021-08-27 23:45:54 +0000 UTC (2+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Init container init1 ready: false, restart count 0 Aug 27 23:46:41.440: INFO: Init container init2 ready: false, restart count 0 Aug 27 23:46:41.440: INFO: Container run1 ready: false, restart count 0 Aug 27 23:46:41.440: INFO: nginx-proxy-node1 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.440: INFO: Container nginx-proxy ready: true, restart count 2 Aug 27 23:46:41.440: INFO: node-exporter-4cvlq started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 27 23:46:41.440: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:46:41.440: INFO: Container node-exporter ready: true, restart count 0 W0827 23:46:41.454187 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 27 23:46:41.493: INFO: Latency metrics for node node1 Aug 27 23:46:41.493: INFO: Logging node info for node node2 Aug 27 23:46:41.495: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eb7da7c0-513f-4072-a078-ad3d24f88114 59277 0 2021-08-27 20:48:09 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:88:9c:d1:39:68"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-27 20:48:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-27 20:48:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-27 20:58:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-27 20:58:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:50:36 +0000 UTC,LastTransitionTime:2021-08-27 20:50:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-27 23:46:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0ccfc2a4a9b7400c9ca53b5de0ca4970,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:26b02690-0814-4c92-9f6d-d315df796ce6,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:331c6faa8b0d5ec72cf105e87d35df0a2f2baeec3d6217a51faa73f9460f937f localhost:30500/barometer-collectd:stable],SizeBytes:1238704157,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[localhost:30500/cmk@sha256:fd1487b0c07556a087eff669e70c501a704720dcd53ff75183593de6720585f2 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:d7300ccf7ff3e9cea2111d275143b8050618bbc1d1ffe41f46286b1696261243 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44393508,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:ae72171f047a37ee5423e0692df7429830919af16e9d668ab0c80b723863d102 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:cd98d1edca8e5e2e3ea42cbc463812483e5d069d10f0974ca9d484b5a7bd68db localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 27 23:46:41.496: INFO: Logging kubelet events for node node2 Aug 27 23:46:41.498: INFO: Logging pods the kubelet thinks is on node node2 Aug 27 23:46:41.511: INFO: nginx-proxy-node2 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container nginx-proxy ready: true, restart count 1 Aug 27 23:46:41.511: INFO: kube-proxy-r4q4t started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container kube-proxy ready: true, restart count 2 Aug 27 23:46:41.511: INFO: kube-multus-ds-amd64-tfffk started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container kube-multus ready: true, restart count 1 Aug 27 23:46:41.511: INFO: node-exporter-p6h5h started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 27 23:46:41.511: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:46:41.511: INFO: Container node-exporter ready: true, restart count 0 Aug 27 23:46:41.511: INFO: cmk-fzjgr started at 2021-08-27 20:58:20 +0000 UTC (0+2 container statuses recorded) Aug 27 23:46:41.511: INFO: Container nodereport ready: true, restart count 0 Aug 27 23:46:41.511: INFO: Container reconcile ready: true, restart count 0 Aug 27 23:46:41.511: INFO: pod-handle-http-request started at 2021-08-27 23:46:19 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container pod-handle-http-request ready: true, restart count 0 Aug 27 23:46:41.511: INFO: pod-service-account-29901aef-ff16-49bc-ac41-0c970d5adaac started at 2021-08-27 23:43:33 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container test ready: false, restart count 0 Aug 27 23:46:41.511: INFO: busybox-d46f04c7-6f69-4518-8c43-12c7adffe2f5 started at 2021-08-27 23:45:47 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container busybox ready: false, restart count 0 Aug 27 23:46:41.511: INFO: ss2-0 started at 2021-08-27 23:39:25 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container webserver ready: true, restart count 0 Aug 27 23:46:41.511: INFO: collectd-64dp2 started at 2021-08-27 21:04:15 +0000 UTC (0+3 container statuses recorded) Aug 27 23:46:41.511: INFO: Container collectd ready: true, restart count 0 Aug 27 23:46:41.511: INFO: Container collectd-exporter ready: true, restart count 0 Aug 27 23:46:41.511: INFO: Container rbac-proxy ready: true, restart count 0 Aug 27 23:46:41.511: INFO: var-expansion-fda203cd-93b6-4495-bddf-3b7b58556a19 started at 2021-08-27 23:45:03 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container dapi-container ready: false, restart count 0 Aug 27 23:46:41.511: INFO: ss-0 started at 2021-08-27 23:45:13 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container webserver ready: false, restart count 0 Aug 27 23:46:41.511: INFO: cmk-webhook-6c9d5f8578-ndbx2 started at 2021-08-27 20:58:20 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container cmk-webhook ready: true, restart count 0 Aug 27 23:46:41.511: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-v99df started at 2021-08-27 21:02:08 +0000 UTC (0+2 container statuses recorded) Aug 27 23:46:41.511: INFO: Container tas-controller ready: true, restart count 0 Aug 27 23:46:41.511: INFO: Container tas-extender ready: true, restart count 0 Aug 27 23:46:41.511: INFO: ss2-2 started at 2021-08-27 23:40:26 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container webserver ready: false, restart count 0 Aug 27 23:46:41.511: INFO: pod-logs-websocket-f7bdb0b2-32b1-4320-8388-1166a6cbc9ab started at 2021-08-27 23:45:22 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container main ready: false, restart count 0 Aug 27 23:46:41.511: INFO: kube-flannel-t9qv4 started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Init container install-cni ready: true, restart count 0 Aug 27 23:46:41.511: INFO: Container kube-flannel ready: true, restart count 2 Aug 27 23:46:41.511: INFO: cmk-init-discover-node2-l9qjd started at 2021-08-27 20:57:57 +0000 UTC (0+3 container statuses recorded) Aug 27 23:46:41.511: INFO: Container discover ready: false, restart count 0 Aug 27 23:46:41.511: INFO: Container init ready: false, restart count 0 Aug 27 23:46:41.511: INFO: Container install ready: false, restart count 0 Aug 27 23:46:41.511: INFO: node-feature-discovery-worker-54lfh started at 2021-08-27 20:55:06 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container nfd-worker ready: true, restart count 0 Aug 27 23:46:41.511: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4f962 started at 2021-08-27 20:55:51 +0000 UTC (0+1 container statuses recorded) Aug 27 23:46:41.511: INFO: Container kube-sriovdp ready: true, restart count 0 W0827 23:46:41.526038 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 27 23:46:41.555: INFO: Latency metrics for node node2 Aug 27 23:46:41.555: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-9530" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 27 23:56:41.626: Failed waiting for pods to enter running: timed out waiting for the condition /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 27 23:46:41.591: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename statefulset STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:103 STEP: Creating service test in namespace statefulset-7197 [It] should perform canary updates and phased rolling updates of template modifications [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a new StatefulSet Aug 27 23:46:41.621: INFO: Found 0 stateful pods, waiting for 3 Aug 27 23:46:51.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:47:01.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:47:11.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:47:21.626: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:47:31.627: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:47:41.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:47:51.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:48:01.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:48:11.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:48:21.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:48:31.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:48:41.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:48:51.626: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:49:01.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:49:11.628: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:49:21.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:49:31.627: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:49:41.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:49:51.627: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:50:01.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:50:11.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:50:21.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:50:31.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:50:41.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:50:51.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:51:01.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:51:11.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:51:21.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:51:31.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:51:41.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:51:51.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:52:01.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:52:11.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:52:21.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:52:31.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:52:41.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:52:51.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:53:01.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:53:11.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:53:21.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:53:31.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:53:41.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:53:51.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:54:01.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:54:11.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:54:21.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:54:31.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:54:41.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:54:51.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:55:01.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:55:11.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:55:21.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:55:31.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:55:41.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:55:51.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:56:01.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:56:11.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:56:21.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:56:31.625: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:56:41.624: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:56:41.626: INFO: Found 1 stateful pods, waiting for 3 Aug 27 23:56:41.626: FAIL: Failed waiting for pods to enter running: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning(0x5411460, 0xc001c766e0, 0x300000003, 0xc001554500) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 +0x10e k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:80 k8s.io/kubernetes/test/e2e/apps.glob..func10.2.8() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:323 +0x2b8 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0018a1e00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0018a1e00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0018a1e00, 0x4dec428) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:114 Aug 27 23:56:41.630: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-7197 describe po ss2-0' Aug 27 23:56:41.799: INFO: stderr: "" Aug 27 23:56:41.799: INFO: stdout: "Name: ss2-0\nNamespace: statefulset-7197\nPriority: 0\nNode: node1/10.10.190.207\nStart Time: Fri, 27 Aug 2021 23:46:41 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-65c7964b94\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-0\nAnnotations: k8s.v1.cni.cncf.io/network-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.3.18\"\n ],\n \"mac\": \"26:04:7d:ab:bd:5c\",\n \"default\": true,\n \"dns\": {}\n }]\n k8s.v1.cni.cncf.io/networks-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.3.18\"\n ],\n \"mac\": \"26:04:7d:ab:bd:5c\",\n \"default\": true,\n \"dns\": {}\n }]\n kubernetes.io/psp: collectd\nStatus: Pending\nIP: 10.244.3.18\nIPs:\n IP: 10.244.3.18\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: \n Image: docker.io/library/httpd:2.4.38-alpine\n Image ID: \n Port: <none>\n Host Port: <none>\n State: Waiting\n Reason: ImagePullBackOff\n Ready: False\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-swldj (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n default-token-swldj:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-swldj\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-7197/ss2-0 to node1\n Normal AddedInterface 9m58s multus Add eth0 [10.244.3.18/24]\n Normal Pulling 8m37s (x4 over 9m58s) kubelet Pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Warning Failed 8m36s (x4 over 9m57s) kubelet Failed to pull image \"docker.io/library/httpd:2.4.38-alpine\": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\n Warning Failed 8m36s (x4 over 9m57s) kubelet Error: ErrImagePull\n Normal BackOff 7m54s (x7 over 9m57s) kubelet Back-off pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Warning Failed 4m44s (x20 over 9m57s) kubelet Error: ImagePullBackOff\n" Aug 27 23:56:41.800: INFO: Output of kubectl describe ss2-0: Name: ss2-0 Namespace: statefulset-7197 Priority: 0 Node: node1/10.10.190.207 Start Time: Fri, 27 Aug 2021 23:46:41 +0000 Labels: baz=blah controller-revision-hash=ss2-65c7964b94 foo=bar statefulset.kubernetes.io/pod-name=ss2-0 Annotations: k8s.v1.cni.cncf.io/network-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.18" ], "mac": "26:04:7d:ab:bd:5c", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.18" ], "mac": "26:04:7d:ab:bd:5c", "default": true, "dns": {} }] kubernetes.io/psp: collectd Status: Pending IP: 10.244.3.18 IPs: IP: 10.244.3.18 Controlled By: StatefulSet/ss2 Containers: webserver: Container ID: Image: docker.io/library/httpd:2.4.38-alpine Image ID: Port: <none> Host Port: <none> State: Waiting Reason: ImagePullBackOff Ready: False Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: <none> Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-swldj (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: default-token-swldj: Type: Secret (a volume populated by a Secret) SecretName: default-token-swldj Optional: false QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-7197/ss2-0 to node1 Normal AddedInterface 9m58s multus Add eth0 [10.244.3.18/24] Normal Pulling 8m37s (x4 over 9m58s) kubelet Pulling image "docker.io/library/httpd:2.4.38-alpine" Warning Failed 8m36s (x4 over 9m57s) kubelet Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Warning Failed 8m36s (x4 over 9m57s) kubelet Error: ErrImagePull Normal BackOff 7m54s (x7 over 9m57s) kubelet Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Warning Failed 4m44s (x20 over 9m57s) kubelet Error: ImagePullBackOff Aug 27 23:56:41.800: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-7197 logs ss2-0 --tail=100' Aug 27 23:56:41.990: INFO: rc: 1 Aug 27 23:56:41.990: INFO: Last 100 log lines of ss2-0: Aug 27 23:56:41.990: INFO: Deleting all statefulset in ns statefulset-7197 Aug 27 23:56:41.993: INFO: Scaling statefulset ss2 to 0 Aug 27 23:56:52.004: INFO: Waiting for statefulset status.replicas updated to 0 Aug 27 23:56:52.006: INFO: Deleting statefulset ss2 [AfterEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "statefulset-7197". STEP: Found 9 events. Aug 27 23:56:52.021: INFO: At 2021-08-27 23:46:41 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-0 in StatefulSet ss2 successful Aug 27 23:56:52.021: INFO: At 2021-08-27 23:46:41 +0000 UTC - event for ss2-0: {default-scheduler } Scheduled: Successfully assigned statefulset-7197/ss2-0 to node1 Aug 27 23:56:52.021: INFO: At 2021-08-27 23:46:43 +0000 UTC - event for ss2-0: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 27 23:56:52.021: INFO: At 2021-08-27 23:46:43 +0000 UTC - event for ss2-0: {multus } AddedInterface: Add eth0 [10.244.3.18/24] Aug 27 23:56:52.021: INFO: At 2021-08-27 23:46:44 +0000 UTC - event for ss2-0: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 27 23:56:52.021: INFO: At 2021-08-27 23:46:44 +0000 UTC - event for ss2-0: {kubelet node1} Failed: Error: ErrImagePull Aug 27 23:56:52.021: INFO: At 2021-08-27 23:46:44 +0000 UTC - event for ss2-0: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 27 23:56:52.021: INFO: At 2021-08-27 23:46:44 +0000 UTC - event for ss2-0: {kubelet node1} Failed: Error: ImagePullBackOff Aug 27 23:56:52.021: INFO: At 2021-08-27 23:56:42 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-0 in StatefulSet ss2 successful Aug 27 23:56:52.024: INFO: POD NODE PHASE GRACE CONDITIONS Aug 27 23:56:52.024: INFO: Aug 27 23:56:52.029: INFO: Logging node info for node master1 Aug 27 23:56:52.031: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 3af53387-5aee-42c1-b0e7-644cf9161d48 64271 0 2021-08-27 20:46:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"92:f8:b6:72:e4:be"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-27 20:46:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-27 20:46:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-08-27 20:46:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:50:56 +0000 UTC,LastTransitionTime:2021-08-27 20:50:56 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:51 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:51 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:51 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-27 23:56:51 +0000 UTC,LastTransitionTime:2021-08-27 20:50:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5d584023135a46ecb77596bf48ed7f2f,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:587cafa0-6de3-49f8-906e-06315a8ff104,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:ae72171f047a37ee5423e0692df7429830919af16e9d668ab0c80b723863d102 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:cd98d1edca8e5e2e3ea42cbc463812483e5d069d10f0974ca9d484b5a7bd68db tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 27 23:56:52.032: INFO: Logging kubelet events for node master1 Aug 27 23:56:52.035: INFO: Logging pods the kubelet thinks is on node master1 Aug 27 23:56:52.043: INFO: kube-scheduler-master1 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.043: INFO: Container kube-scheduler ready: true, restart count 0 Aug 27 23:56:52.043: INFO: kube-flannel-pp7vp started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 27 23:56:52.043: INFO: Init container install-cni ready: true, restart count 0 Aug 27 23:56:52.043: INFO: Container kube-flannel ready: true, restart count 3 Aug 27 23:56:52.043: INFO: kube-multus-ds-amd64-sfr9k started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.043: INFO: Container kube-multus ready: true, restart count 1 Aug 27 23:56:52.043: INFO: docker-registry-docker-registry-56cbc7bc58-cthtt started at 2021-08-27 20:51:47 +0000 UTC (0+2 container statuses recorded) Aug 27 23:56:52.043: INFO: Container docker-registry ready: true, restart count 0 Aug 27 23:56:52.043: INFO: Container nginx ready: true, restart count 0 Aug 27 23:56:52.043: INFO: kube-apiserver-master1 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.043: INFO: Container kube-apiserver ready: true, restart count 0 Aug 27 23:56:52.043: INFO: kube-controller-manager-master1 started at 2021-08-27 20:54:27 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.043: INFO: Container kube-controller-manager ready: true, restart count 3 Aug 27 23:56:52.043: INFO: kube-proxy-rb5p6 started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.043: INFO: Container kube-proxy ready: true, restart count 1 Aug 27 23:56:52.043: INFO: coredns-7677f9bb54-dwtp5 started at 2021-08-27 20:49:16 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.043: INFO: Container coredns ready: true, restart count 1 Aug 27 23:56:52.043: INFO: node-exporter-z2ngr started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 27 23:56:52.043: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:56:52.043: INFO: Container node-exporter ready: true, restart count 0 W0827 23:56:52.055155 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 27 23:56:52.080: INFO: Latency metrics for node master1 Aug 27 23:56:52.080: INFO: Logging node info for node master2 Aug 27 23:56:52.083: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 666e473f-d9e6-4c06-8b56-06474d788f70 64223 0 2021-08-27 20:46:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"42:86:ff:30:bd:4d"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-27 20:46:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-27 20:46:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-27 20:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:53 +0000 UTC,LastTransitionTime:2021-08-27 20:51:53 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:49 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:49 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:49 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-27 23:56:49 +0000 UTC,LastTransitionTime:2021-08-27 20:48:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2835065974a64998811b9acd85de209b,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:309b9155-1e2a-4ebd-900f-bba5abfc3a5d,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 27 23:56:52.083: INFO: Logging kubelet events for node master2 Aug 27 23:56:52.085: INFO: Logging pods the kubelet thinks is on node master2 Aug 27 23:56:52.095: INFO: kube-controller-manager-master2 started at 2021-08-27 20:51:01 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.095: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 27 23:56:52.095: INFO: kube-flannel-4znnq started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 27 23:56:52.095: INFO: Init container install-cni ready: true, restart count 2 Aug 27 23:56:52.095: INFO: Container kube-flannel ready: true, restart count 2 Aug 27 23:56:52.095: INFO: kube-multus-ds-amd64-4mgbk started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.095: INFO: Container kube-multus ready: true, restart count 1 Aug 27 23:56:52.095: INFO: prometheus-operator-5bb8cb9d8f-whr5p started at 2021-08-27 20:59:06 +0000 UTC (0+2 container statuses recorded) Aug 27 23:56:52.095: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:56:52.095: INFO: Container prometheus-operator ready: true, restart count 0 Aug 27 23:56:52.095: INFO: node-exporter-96jk5 started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 27 23:56:52.095: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:56:52.095: INFO: Container node-exporter ready: true, restart count 0 Aug 27 23:56:52.095: INFO: kube-apiserver-master2 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.095: INFO: Container kube-apiserver ready: true, restart count 0 Aug 27 23:56:52.095: INFO: kube-scheduler-master2 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.095: INFO: Container kube-scheduler ready: true, restart count 2 Aug 27 23:56:52.095: INFO: kube-proxy-b4mn9 started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.095: INFO: Container kube-proxy ready: true, restart count 1 Aug 27 23:56:52.095: INFO: node-feature-discovery-controller-5bf5c49849-zr9zd started at 2021-08-27 20:55:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.095: INFO: Container nfd-controller ready: true, restart count 0 W0827 23:56:52.108402 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 27 23:56:52.142: INFO: Latency metrics for node master2 Aug 27 23:56:52.142: INFO: Logging node info for node master3 Aug 27 23:56:52.145: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 620b6dba-f2c5-46e9-b2ff-d2f4197167d0 64170 0 2021-08-27 20:47:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ce:de:ea:c3:40:4f"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-27 20:47:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-27 20:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-27 20:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:44 +0000 UTC,LastTransitionTime:2021-08-27 20:51:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:48 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:48 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:48 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-27 23:56:48 +0000 UTC,LastTransitionTime:2021-08-27 20:48:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:37decbffe0e84048b5801289ad3be5bf,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:c96fe8b9-1ce0-44cd-935a-b58987e26570,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496891,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 27 23:56:52.145: INFO: Logging kubelet events for node master3 Aug 27 23:56:52.147: INFO: Logging pods the kubelet thinks is on node master3 Aug 27 23:56:52.156: INFO: node-exporter-d4m7q started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 27 23:56:52.156: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:56:52.156: INFO: Container node-exporter ready: true, restart count 0 Aug 27 23:56:52.156: INFO: kube-apiserver-master3 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.156: INFO: Container kube-apiserver ready: true, restart count 0 Aug 27 23:56:52.156: INFO: kube-scheduler-master3 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.156: INFO: Container kube-scheduler ready: true, restart count 2 Aug 27 23:56:52.156: INFO: kube-multus-ds-amd64-wwcgv started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.156: INFO: Container kube-multus ready: true, restart count 1 Aug 27 23:56:52.156: INFO: dns-autoscaler-5b7b5c9b6f-54xch started at 2021-08-27 20:49:19 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.156: INFO: Container autoscaler ready: true, restart count 1 Aug 27 23:56:52.156: INFO: coredns-7677f9bb54-rxplt started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.156: INFO: Container coredns ready: true, restart count 1 Aug 27 23:56:52.156: INFO: kube-controller-manager-master3 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.156: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 27 23:56:52.156: INFO: kube-proxy-8sxhm started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.156: INFO: Container kube-proxy ready: true, restart count 1 Aug 27 23:56:52.156: INFO: kube-flannel-fkz5d started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 27 23:56:52.156: INFO: Init container install-cni ready: true, restart count 0 Aug 27 23:56:52.156: INFO: Container kube-flannel ready: true, restart count 1 W0827 23:56:52.169622 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 27 23:56:52.193: INFO: Latency metrics for node master3 Aug 27 23:56:52.193: INFO: Logging node info for node node1 Aug 27 23:56:52.196: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 e7a2481e-32db-4c83-bd9f-4a0687258e7a 64077 0 2021-08-27 20:48:09 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"56:c7:37:40:51:ca"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-27 20:48:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-27 20:48:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-27 20:57:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-27 20:57:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:49 +0000 UTC,LastTransitionTime:2021-08-27 20:51:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:44 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:44 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:44 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-27 23:56:44 +0000 UTC,LastTransitionTime:2021-08-27 20:48:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c1e38e80ea114a5f96601202301ce842,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:e769e86d-15c0-442c-a93b-bcc6c33ff1cd,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:331c6faa8b0d5ec72cf105e87d35df0a2f2baeec3d6217a51faa73f9460f937f localhost:30500/barometer-collectd:stable],SizeBytes:1238704157,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1003787960,},ContainerImage{Names:[localhost:30500/cmk@sha256:fd1487b0c07556a087eff669e70c501a704720dcd53ff75183593de6720585f2 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:d7300ccf7ff3e9cea2111d275143b8050618bbc1d1ffe41f46286b1696261243 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44393508,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 27 23:56:52.197: INFO: Logging kubelet events for node node1 Aug 27 23:56:52.199: INFO: Logging pods the kubelet thinks is on node node1 Aug 27 23:56:52.215: INFO: kubernetes-dashboard-86c6f9df5b-c56fg started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container kubernetes-dashboard ready: true, restart count 1 Aug 27 23:56:52.215: INFO: node-feature-discovery-worker-bd9kg started at 2021-08-27 20:55:06 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container nfd-worker ready: true, restart count 0 Aug 27 23:56:52.215: INFO: fail-once-local-nnfjf started at 2021-08-27 23:51:47 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container c ready: false, restart count 0 Aug 27 23:56:52.215: INFO: downward-api-1b4ad441-2b80-4fec-922c-5948ba3a182a started at 2021-08-27 23:54:01 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container dapi-container ready: false, restart count 0 Aug 27 23:56:52.215: INFO: simpletest.rc-ljvnc started at 2021-08-27 23:56:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container nginx ready: false, restart count 0 Aug 27 23:56:52.215: INFO: kube-proxy-pb5bl started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container kube-proxy ready: true, restart count 2 Aug 27 23:56:52.215: INFO: collectd-ccvwg started at 2021-08-27 21:04:15 +0000 UTC (0+3 container statuses recorded) Aug 27 23:56:52.215: INFO: Container collectd ready: true, restart count 0 Aug 27 23:56:52.215: INFO: Container collectd-exporter ready: true, restart count 0 Aug 27 23:56:52.215: INFO: Container rbac-proxy ready: true, restart count 0 Aug 27 23:56:52.215: INFO: prometheus-k8s-0 started at 2021-08-27 20:59:29 +0000 UTC (0+5 container statuses recorded) Aug 27 23:56:52.215: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 27 23:56:52.215: INFO: Container grafana ready: true, restart count 0 Aug 27 23:56:52.215: INFO: Container prometheus ready: true, restart count 1 Aug 27 23:56:52.215: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 27 23:56:52.215: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 27 23:56:52.215: INFO: simpletest.rc-bph7k started at 2021-08-27 23:56:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container nginx ready: false, restart count 0 Aug 27 23:56:52.215: INFO: pod-handle-http-request started at 2021-08-27 23:56:29 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container pod-handle-http-request ready: false, restart count 0 Aug 27 23:56:52.215: INFO: kube-flannel-ssxn7 started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Init container install-cni ready: true, restart count 0 Aug 27 23:56:52.215: INFO: Container kube-flannel ready: true, restart count 1 Aug 27 23:56:52.215: INFO: kube-multus-ds-amd64-nn7bl started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container kube-multus ready: true, restart count 1 Aug 27 23:56:52.215: INFO: kubernetes-metrics-scraper-678c97765c-gtp5x started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 Aug 27 23:56:52.215: INFO: cmk-init-discover-node1-spg26 started at 2021-08-27 20:57:37 +0000 UTC (0+3 container statuses recorded) Aug 27 23:56:52.215: INFO: Container discover ready: false, restart count 0 Aug 27 23:56:52.215: INFO: Container init ready: false, restart count 0 Aug 27 23:56:52.215: INFO: Container install ready: false, restart count 0 Aug 27 23:56:52.215: INFO: cmk-jw4m6 started at 2021-08-27 20:58:19 +0000 UTC (0+2 container statuses recorded) Aug 27 23:56:52.215: INFO: Container nodereport ready: true, restart count 0 Aug 27 23:56:52.215: INFO: Container reconcile ready: true, restart count 0 Aug 27 23:56:52.215: INFO: affinity-clusterip-2d5mz started at 2021-08-27 23:56:47 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container affinity-clusterip ready: true, restart count 0 Aug 27 23:56:52.215: INFO: simpletest.rc-xjtnc started at 2021-08-27 23:56:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container nginx ready: false, restart count 0 Aug 27 23:56:52.215: INFO: nginx-proxy-node1 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container nginx-proxy ready: true, restart count 2 Aug 27 23:56:52.215: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-9lndx started at 2021-08-27 20:55:51 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 27 23:56:52.215: INFO: node-exporter-4cvlq started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 27 23:56:52.215: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:56:52.215: INFO: Container node-exporter ready: true, restart count 0 Aug 27 23:56:52.215: INFO: simpletest.rc-v9lvk started at 2021-08-27 23:56:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container nginx ready: false, restart count 0 Aug 27 23:56:52.215: INFO: affinity-clusterip-tcggw started at 2021-08-27 23:56:47 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container affinity-clusterip ready: true, restart count 0 Aug 27 23:56:52.215: INFO: simpletest.rc-25xv6 started at 2021-08-27 23:56:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.215: INFO: Container nginx ready: false, restart count 0 W0827 23:56:52.226734 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 27 23:56:52.306: INFO: Latency metrics for node node1 Aug 27 23:56:52.306: INFO: Logging node info for node node2 Aug 27 23:56:52.309: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eb7da7c0-513f-4072-a078-ad3d24f88114 64243 0 2021-08-27 20:48:09 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:88:9c:d1:39:68"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-27 20:48:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-27 20:48:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-27 20:58:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-27 20:58:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:50:36 +0000 UTC,LastTransitionTime:2021-08-27 20:50:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:50 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:50 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-27 23:56:50 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-27 23:56:50 +0000 UTC,LastTransitionTime:2021-08-27 20:48:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0ccfc2a4a9b7400c9ca53b5de0ca4970,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:26b02690-0814-4c92-9f6d-d315df796ce6,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:331c6faa8b0d5ec72cf105e87d35df0a2f2baeec3d6217a51faa73f9460f937f localhost:30500/barometer-collectd:stable],SizeBytes:1238704157,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[localhost:30500/cmk@sha256:fd1487b0c07556a087eff669e70c501a704720dcd53ff75183593de6720585f2 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:d7300ccf7ff3e9cea2111d275143b8050618bbc1d1ffe41f46286b1696261243 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44393508,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:ae72171f047a37ee5423e0692df7429830919af16e9d668ab0c80b723863d102 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:cd98d1edca8e5e2e3ea42cbc463812483e5d069d10f0974ca9d484b5a7bd68db localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 27 23:56:52.310: INFO: Logging kubelet events for node node2 Aug 27 23:56:52.312: INFO: Logging pods the kubelet thinks is on node node2 Aug 27 23:56:52.327: INFO: cmk-fzjgr started at 2021-08-27 20:58:20 +0000 UTC (0+2 container statuses recorded) Aug 27 23:56:52.327: INFO: Container nodereport ready: true, restart count 0 Aug 27 23:56:52.327: INFO: Container reconcile ready: true, restart count 0 Aug 27 23:56:52.327: INFO: collectd-64dp2 started at 2021-08-27 21:04:15 +0000 UTC (0+3 container statuses recorded) Aug 27 23:56:52.327: INFO: Container collectd ready: true, restart count 0 Aug 27 23:56:52.327: INFO: Container collectd-exporter ready: true, restart count 0 Aug 27 23:56:52.327: INFO: Container rbac-proxy ready: true, restart count 0 Aug 27 23:56:52.327: INFO: pod-submit-remove-e0fe8833-506c-4fe2-a611-59e5057e1de3 started at 2021-08-27 23:55:30 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container nginx ready: false, restart count 0 Aug 27 23:56:52.327: INFO: simpletest.rc-b26cd started at 2021-08-27 23:56:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container nginx ready: false, restart count 0 Aug 27 23:56:52.327: INFO: simpletest.rc-zdc5h started at 2021-08-27 23:56:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container nginx ready: false, restart count 0 Aug 27 23:56:52.327: INFO: affinity-clusterip-cbkh9 started at 2021-08-27 23:56:47 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container affinity-clusterip ready: true, restart count 0 Aug 27 23:56:52.327: INFO: termination-message-containerb63ba40d-d78f-4ca5-96aa-cb4853e10188 started at 2021-08-27 23:56:43 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container termination-message-container ready: false, restart count 0 Aug 27 23:56:52.327: INFO: simpletest.rc-fhhc4 started at 2021-08-27 23:56:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container nginx ready: false, restart count 0 Aug 27 23:56:52.327: INFO: cmk-webhook-6c9d5f8578-ndbx2 started at 2021-08-27 20:58:20 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container cmk-webhook ready: true, restart count 0 Aug 27 23:56:52.327: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-v99df started at 2021-08-27 21:02:08 +0000 UTC (0+2 container statuses recorded) Aug 27 23:56:52.327: INFO: Container tas-controller ready: true, restart count 0 Aug 27 23:56:52.327: INFO: Container tas-extender ready: true, restart count 0 Aug 27 23:56:52.327: INFO: kube-flannel-t9qv4 started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Init container install-cni ready: true, restart count 0 Aug 27 23:56:52.327: INFO: Container kube-flannel ready: true, restart count 2 Aug 27 23:56:52.327: INFO: cmk-init-discover-node2-l9qjd started at 2021-08-27 20:57:57 +0000 UTC (0+3 container statuses recorded) Aug 27 23:56:52.327: INFO: Container discover ready: false, restart count 0 Aug 27 23:56:52.327: INFO: Container init ready: false, restart count 0 Aug 27 23:56:52.327: INFO: Container install ready: false, restart count 0 Aug 27 23:56:52.327: INFO: liveness-7e772482-c1e2-49b8-ba66-1136c1b3bc69 started at 2021-08-27 23:56:01 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container liveness ready: true, restart count 2 Aug 27 23:56:52.327: INFO: simpletest.rc-k56nr started at 2021-08-27 23:56:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container nginx ready: false, restart count 0 Aug 27 23:56:52.327: INFO: node-feature-discovery-worker-54lfh started at 2021-08-27 20:55:06 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container nfd-worker ready: true, restart count 0 Aug 27 23:56:52.327: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4f962 started at 2021-08-27 20:55:51 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 27 23:56:52.327: INFO: pod-init-87bf8589-6bea-4e5f-a081-a4af5b3a51cb started at 2021-08-27 23:55:52 +0000 UTC (2+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Init container init1 ready: false, restart count 0 Aug 27 23:56:52.327: INFO: Init container init2 ready: false, restart count 0 Aug 27 23:56:52.327: INFO: Container run1 ready: false, restart count 0 Aug 27 23:56:52.327: INFO: simpletest.rc-j5wqr started at 2021-08-27 23:56:09 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container nginx ready: false, restart count 0 Aug 27 23:56:52.327: INFO: pod-configmaps-97befb70-76fa-4cc9-ae71-edd994d168b1 started at 2021-08-27 23:55:27 +0000 UTC (0+3 container statuses recorded) Aug 27 23:56:52.327: INFO: Container createcm-volume-test ready: false, restart count 0 Aug 27 23:56:52.327: INFO: Container delcm-volume-test ready: false, restart count 0 Aug 27 23:56:52.327: INFO: Container updcm-volume-test ready: false, restart count 0 Aug 27 23:56:52.327: INFO: nginx-proxy-node2 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container nginx-proxy ready: true, restart count 1 Aug 27 23:56:52.327: INFO: kube-proxy-r4q4t started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container kube-proxy ready: true, restart count 2 Aug 27 23:56:52.327: INFO: kube-multus-ds-amd64-tfffk started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container kube-multus ready: true, restart count 1 Aug 27 23:56:52.327: INFO: node-exporter-p6h5h started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 27 23:56:52.327: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 27 23:56:52.327: INFO: Container node-exporter ready: true, restart count 0 Aug 27 23:56:52.327: INFO: ss-0 started at 2021-08-27 23:47:20 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container webserver ready: false, restart count 0 Aug 27 23:56:52.327: INFO: fail-once-local-rthxs started at 2021-08-27 23:51:47 +0000 UTC (0+1 container statuses recorded) Aug 27 23:56:52.327: INFO: Container c ready: false, restart count 0 W0827 23:56:52.341103 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 27 23:56:52.379: INFO: Latency metrics for node node2 Aug 27 23:56:52.379: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "statefulset-7197" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 28 00:06:52.525: Failed waiting for pods to enter running: timed out waiting for the condition /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 27 23:56:52.488: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename statefulset STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:103 STEP: Creating service test in namespace statefulset-5967 [It] Burst scaling should run to completion even with unhealthy pods [Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating stateful set ss in namespace statefulset-5967 STEP: Waiting until all stateful set ss replicas will be running in namespace statefulset-5967 Aug 27 23:56:52.519: INFO: Found 0 stateful pods, waiting for 1 Aug 27 23:57:02.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:57:12.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:57:22.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:57:32.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:57:42.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:57:52.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:58:02.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:58:12.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:58:22.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:58:32.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:58:42.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:58:52.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:59:02.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:59:12.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:59:22.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:59:32.525: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:59:42.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 27 23:59:52.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:00:02.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:00:12.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:00:22.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:00:32.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:00:42.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:00:52.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:01:02.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:01:12.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:01:22.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:01:32.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:01:42.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:01:52.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:02:02.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:02:12.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:02:22.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:02:32.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:02:42.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:02:52.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:03:02.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:03:12.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:03:22.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:03:32.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:03:42.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:03:52.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:04:02.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:04:12.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:04:22.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:04:32.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:04:42.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:04:52.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:05:02.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:05:12.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:05:22.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:05:32.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:05:42.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:05:52.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:06:02.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:06:12.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:06:22.524: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:06:32.523: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:06:42.533: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:06:52.522: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:06:52.525: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 28 00:06:52.525: FAIL: Failed waiting for pods to enter running: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning(0x5411460, 0xc00453a580, 0x100000001, 0xc004364000) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 +0x10e k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:80 k8s.io/kubernetes/test/e2e/apps.glob..func10.2.11() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:698 +0x395 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0018a1e00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0018a1e00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0018a1e00, 0x4dec428) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:114 Aug 28 00:06:52.529: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-5967 describe po ss-0' Aug 28 00:06:52.691: INFO: stderr: "" Aug 28 00:06:52.691: INFO: stdout: "Name: ss-0\nNamespace: statefulset-5967\nPriority: 0\nNode: node1/10.10.190.207\nStart Time: Fri, 27 Aug 2021 23:56:52 +0000\nLabels: baz=blah\n controller-revision-hash=ss-65c7964b94\n foo=bar\n statefulset.kubernetes.io/pod-name=ss-0\nAnnotations: k8s.v1.cni.cncf.io/network-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.3.50\"\n ],\n \"mac\": \"d6:ef:87:f3:47:12\",\n \"default\": true,\n \"dns\": {}\n }]\n k8s.v1.cni.cncf.io/networks-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.3.50\"\n ],\n \"mac\": \"d6:ef:87:f3:47:12\",\n \"default\": true,\n \"dns\": {}\n }]\n kubernetes.io/psp: collectd\nStatus: Pending\nIP: 10.244.3.50\nIPs:\n IP: 10.244.3.50\nControlled By: StatefulSet/ss\nContainers:\n webserver:\n Container ID: \n Image: docker.io/library/httpd:2.4.38-alpine\n Image ID: \n Port: <none>\n Host Port: <none>\n State: Waiting\n Reason: ImagePullBackOff\n Ready: False\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-pldkq (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n default-token-pldkq:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-pldkq\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-5967/ss-0 to node1\n Normal AddedInterface 9m58s multus Add eth0 [10.244.3.48/24]\n Normal SandboxChanged 9m56s kubelet Pod sandbox changed, it will be killed and re-created.\n Normal AddedInterface 9m54s multus Add eth0 [10.244.3.50/24]\n Warning Failed 9m11s (x3 over 9m57s) kubelet Failed to pull image \"docker.io/library/httpd:2.4.38-alpine\": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\n Warning Failed 9m11s (x3 over 9m57s) kubelet Error: ErrImagePull\n Normal BackOff 8m34s (x7 over 9m54s) kubelet Back-off pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Normal Pulling 8m22s (x4 over 9m58s) kubelet Pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Warning Failed 4m55s (x21 over 9m54s) kubelet Error: ImagePullBackOff\n" Aug 28 00:06:52.691: INFO: Output of kubectl describe ss-0: Name: ss-0 Namespace: statefulset-5967 Priority: 0 Node: node1/10.10.190.207 Start Time: Fri, 27 Aug 2021 23:56:52 +0000 Labels: baz=blah controller-revision-hash=ss-65c7964b94 foo=bar statefulset.kubernetes.io/pod-name=ss-0 Annotations: k8s.v1.cni.cncf.io/network-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.50" ], "mac": "d6:ef:87:f3:47:12", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.50" ], "mac": "d6:ef:87:f3:47:12", "default": true, "dns": {} }] kubernetes.io/psp: collectd Status: Pending IP: 10.244.3.50 IPs: IP: 10.244.3.50 Controlled By: StatefulSet/ss Containers: webserver: Container ID: Image: docker.io/library/httpd:2.4.38-alpine Image ID: Port: <none> Host Port: <none> State: Waiting Reason: ImagePullBackOff Ready: False Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: <none> Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-pldkq (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: default-token-pldkq: Type: Secret (a volume populated by a Secret) SecretName: default-token-pldkq Optional: false QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-5967/ss-0 to node1 Normal AddedInterface 9m58s multus Add eth0 [10.244.3.48/24] Normal SandboxChanged 9m56s kubelet Pod sandbox changed, it will be killed and re-created. Normal AddedInterface 9m54s multus Add eth0 [10.244.3.50/24] Warning Failed 9m11s (x3 over 9m57s) kubelet Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Warning Failed 9m11s (x3 over 9m57s) kubelet Error: ErrImagePull Normal BackOff 8m34s (x7 over 9m54s) kubelet Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Normal Pulling 8m22s (x4 over 9m58s) kubelet Pulling image "docker.io/library/httpd:2.4.38-alpine" Warning Failed 4m55s (x21 over 9m54s) kubelet Error: ImagePullBackOff Aug 28 00:06:52.691: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-5967 logs ss-0 --tail=100' Aug 28 00:06:52.844: INFO: rc: 1 Aug 28 00:06:52.844: INFO: Last 100 log lines of ss-0: Aug 28 00:06:52.844: INFO: Deleting all statefulset in ns statefulset-5967 Aug 28 00:06:52.846: INFO: Scaling statefulset ss to 0 Aug 28 00:07:02.859: INFO: Waiting for statefulset status.replicas updated to 0 Aug 28 00:07:02.862: INFO: Deleting statefulset ss [AfterEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "statefulset-5967". STEP: Found 11 events. Aug 28 00:07:02.876: INFO: At 2021-08-27 23:56:52 +0000 UTC - event for ss: {statefulset-controller } SuccessfulCreate: create Pod ss-0 in StatefulSet ss successful Aug 28 00:07:02.876: INFO: At 2021-08-27 23:56:52 +0000 UTC - event for ss-0: {default-scheduler } Scheduled: Successfully assigned statefulset-5967/ss-0 to node1 Aug 28 00:07:02.876: INFO: At 2021-08-27 23:56:54 +0000 UTC - event for ss-0: {multus } AddedInterface: Add eth0 [10.244.3.48/24] Aug 28 00:07:02.876: INFO: At 2021-08-27 23:56:54 +0000 UTC - event for ss-0: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 28 00:07:02.876: INFO: At 2021-08-27 23:56:55 +0000 UTC - event for ss-0: {kubelet node1} Failed: Error: ErrImagePull Aug 28 00:07:02.876: INFO: At 2021-08-27 23:56:55 +0000 UTC - event for ss-0: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 28 00:07:02.876: INFO: At 2021-08-27 23:56:56 +0000 UTC - event for ss-0: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 28 00:07:02.876: INFO: At 2021-08-27 23:56:58 +0000 UTC - event for ss-0: {multus } AddedInterface: Add eth0 [10.244.3.50/24] Aug 28 00:07:02.876: INFO: At 2021-08-27 23:56:58 +0000 UTC - event for ss-0: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 28 00:07:02.876: INFO: At 2021-08-27 23:56:58 +0000 UTC - event for ss-0: {kubelet node1} Failed: Error: ImagePullBackOff Aug 28 00:07:02.876: INFO: At 2021-08-28 00:06:52 +0000 UTC - event for ss: {statefulset-controller } SuccessfulDelete: delete Pod ss-0 in StatefulSet ss successful Aug 28 00:07:02.878: INFO: POD NODE PHASE GRACE CONDITIONS Aug 28 00:07:02.878: INFO: Aug 28 00:07:02.882: INFO: Logging node info for node master1 Aug 28 00:07:02.885: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 3af53387-5aee-42c1-b0e7-644cf9161d48 69158 0 2021-08-27 20:46:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"92:f8:b6:72:e4:be"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-27 20:46:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-27 20:46:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-08-27 20:46:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:50:56 +0000 UTC,LastTransitionTime:2021-08-27 20:50:56 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:06:54 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:06:54 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:06:54 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:06:54 +0000 UTC,LastTransitionTime:2021-08-27 20:50:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5d584023135a46ecb77596bf48ed7f2f,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:587cafa0-6de3-49f8-906e-06315a8ff104,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:ae72171f047a37ee5423e0692df7429830919af16e9d668ab0c80b723863d102 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:cd98d1edca8e5e2e3ea42cbc463812483e5d069d10f0974ca9d484b5a7bd68db tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:07:02.885: INFO: Logging kubelet events for node master1 Aug 28 00:07:02.887: INFO: Logging pods the kubelet thinks is on node master1 Aug 28 00:07:02.896: INFO: kube-proxy-rb5p6 started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.896: INFO: Container kube-proxy ready: true, restart count 1 Aug 28 00:07:02.896: INFO: coredns-7677f9bb54-dwtp5 started at 2021-08-27 20:49:16 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.896: INFO: Container coredns ready: true, restart count 1 Aug 28 00:07:02.896: INFO: node-exporter-z2ngr started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:07:02.896: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:07:02.896: INFO: Container node-exporter ready: true, restart count 0 Aug 28 00:07:02.896: INFO: kube-apiserver-master1 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.896: INFO: Container kube-apiserver ready: true, restart count 0 Aug 28 00:07:02.896: INFO: kube-controller-manager-master1 started at 2021-08-27 20:54:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.896: INFO: Container kube-controller-manager ready: true, restart count 3 Aug 28 00:07:02.896: INFO: kube-multus-ds-amd64-sfr9k started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.896: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:07:02.896: INFO: docker-registry-docker-registry-56cbc7bc58-cthtt started at 2021-08-27 20:51:47 +0000 UTC (0+2 container statuses recorded) Aug 28 00:07:02.896: INFO: Container docker-registry ready: true, restart count 0 Aug 28 00:07:02.896: INFO: Container nginx ready: true, restart count 0 Aug 28 00:07:02.896: INFO: kube-scheduler-master1 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.896: INFO: Container kube-scheduler ready: true, restart count 0 Aug 28 00:07:02.896: INFO: kube-flannel-pp7vp started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:07:02.896: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:07:02.896: INFO: Container kube-flannel ready: true, restart count 3 W0828 00:07:02.909246 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:07:02.933: INFO: Latency metrics for node master1 Aug 28 00:07:02.933: INFO: Logging node info for node master2 Aug 28 00:07:02.935: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 666e473f-d9e6-4c06-8b56-06474d788f70 69218 0 2021-08-27 20:46:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"42:86:ff:30:bd:4d"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-27 20:46:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-27 20:46:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-27 20:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:53 +0000 UTC,LastTransitionTime:2021-08-27 20:51:53 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:07:02 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:07:02 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:07:02 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:07:02 +0000 UTC,LastTransitionTime:2021-08-27 20:48:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2835065974a64998811b9acd85de209b,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:309b9155-1e2a-4ebd-900f-bba5abfc3a5d,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:07:02.935: INFO: Logging kubelet events for node master2 Aug 28 00:07:02.937: INFO: Logging pods the kubelet thinks is on node master2 Aug 28 00:07:02.945: INFO: kube-apiserver-master2 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.945: INFO: Container kube-apiserver ready: true, restart count 0 Aug 28 00:07:02.945: INFO: kube-scheduler-master2 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.945: INFO: Container kube-scheduler ready: true, restart count 2 Aug 28 00:07:02.945: INFO: kube-proxy-b4mn9 started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.945: INFO: Container kube-proxy ready: true, restart count 1 Aug 28 00:07:02.945: INFO: node-feature-discovery-controller-5bf5c49849-zr9zd started at 2021-08-27 20:55:09 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.945: INFO: Container nfd-controller ready: true, restart count 0 Aug 28 00:07:02.945: INFO: node-exporter-96jk5 started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:07:02.945: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:07:02.945: INFO: Container node-exporter ready: true, restart count 0 Aug 28 00:07:02.945: INFO: kube-controller-manager-master2 started at 2021-08-27 20:51:01 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.945: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 28 00:07:02.945: INFO: kube-flannel-4znnq started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:07:02.945: INFO: Init container install-cni ready: true, restart count 2 Aug 28 00:07:02.945: INFO: Container kube-flannel ready: true, restart count 2 Aug 28 00:07:02.945: INFO: kube-multus-ds-amd64-4mgbk started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.945: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:07:02.945: INFO: prometheus-operator-5bb8cb9d8f-whr5p started at 2021-08-27 20:59:06 +0000 UTC (0+2 container statuses recorded) Aug 28 00:07:02.945: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:07:02.945: INFO: Container prometheus-operator ready: true, restart count 0 W0828 00:07:02.961122 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:07:02.984: INFO: Latency metrics for node master2 Aug 28 00:07:02.984: INFO: Logging node info for node master3 Aug 28 00:07:02.987: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 620b6dba-f2c5-46e9-b2ff-d2f4197167d0 69211 0 2021-08-27 20:47:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ce:de:ea:c3:40:4f"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-27 20:47:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-27 20:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-27 20:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:44 +0000 UTC,LastTransitionTime:2021-08-27 20:51:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:07:00 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:07:00 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:07:00 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:07:00 +0000 UTC,LastTransitionTime:2021-08-27 20:48:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:37decbffe0e84048b5801289ad3be5bf,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:c96fe8b9-1ce0-44cd-935a-b58987e26570,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496891,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:07:02.988: INFO: Logging kubelet events for node master3 Aug 28 00:07:02.990: INFO: Logging pods the kubelet thinks is on node master3 Aug 28 00:07:02.999: INFO: coredns-7677f9bb54-rxplt started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.999: INFO: Container coredns ready: true, restart count 1 Aug 28 00:07:02.999: INFO: kube-controller-manager-master3 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.999: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 28 00:07:02.999: INFO: kube-proxy-8sxhm started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.999: INFO: Container kube-proxy ready: true, restart count 1 Aug 28 00:07:02.999: INFO: kube-flannel-fkz5d started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:07:02.999: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:07:02.999: INFO: Container kube-flannel ready: true, restart count 1 Aug 28 00:07:02.999: INFO: dns-autoscaler-5b7b5c9b6f-54xch started at 2021-08-27 20:49:19 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.999: INFO: Container autoscaler ready: true, restart count 1 Aug 28 00:07:02.999: INFO: kube-apiserver-master3 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.999: INFO: Container kube-apiserver ready: true, restart count 0 Aug 28 00:07:02.999: INFO: kube-scheduler-master3 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.999: INFO: Container kube-scheduler ready: true, restart count 2 Aug 28 00:07:02.999: INFO: kube-multus-ds-amd64-wwcgv started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:02.999: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:07:02.999: INFO: node-exporter-d4m7q started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:07:02.999: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:07:02.999: INFO: Container node-exporter ready: true, restart count 0 W0828 00:07:03.010987 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:07:03.032: INFO: Latency metrics for node master3 Aug 28 00:07:03.032: INFO: Logging node info for node node1 Aug 28 00:07:03.036: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 e7a2481e-32db-4c83-bd9f-4a0687258e7a 69201 0 2021-08-27 20:48:09 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"56:c7:37:40:51:ca"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-27 20:48:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-27 20:48:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-27 20:57:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-27 20:57:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:49 +0000 UTC,LastTransitionTime:2021-08-27 20:51:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:06:58 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:06:58 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:06:58 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:06:58 +0000 UTC,LastTransitionTime:2021-08-27 20:48:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c1e38e80ea114a5f96601202301ce842,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:e769e86d-15c0-442c-a93b-bcc6c33ff1cd,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:331c6faa8b0d5ec72cf105e87d35df0a2f2baeec3d6217a51faa73f9460f937f localhost:30500/barometer-collectd:stable],SizeBytes:1238704157,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1003787960,},ContainerImage{Names:[localhost:30500/cmk@sha256:fd1487b0c07556a087eff669e70c501a704720dcd53ff75183593de6720585f2 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:d7300ccf7ff3e9cea2111d275143b8050618bbc1d1ffe41f46286b1696261243 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44393508,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:07:03.036: INFO: Logging kubelet events for node node1 Aug 28 00:07:03.038: INFO: Logging pods the kubelet thinks is on node node1 Aug 28 00:07:03.052: INFO: kube-flannel-ssxn7 started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:07:03.052: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:07:03.052: INFO: Container kube-flannel ready: true, restart count 1 Aug 28 00:07:03.052: INFO: cmk-init-discover-node1-spg26 started at 2021-08-27 20:57:37 +0000 UTC (0+3 container statuses recorded) Aug 28 00:07:03.052: INFO: Container discover ready: false, restart count 0 Aug 28 00:07:03.052: INFO: Container init ready: false, restart count 0 Aug 28 00:07:03.052: INFO: Container install ready: false, restart count 0 Aug 28 00:07:03.052: INFO: cmk-jw4m6 started at 2021-08-27 20:58:19 +0000 UTC (0+2 container statuses recorded) Aug 28 00:07:03.052: INFO: Container nodereport ready: true, restart count 0 Aug 28 00:07:03.052: INFO: Container reconcile ready: true, restart count 0 Aug 28 00:07:03.052: INFO: pod-configmaps-083121aa-d5da-435b-b71e-278033dca23d started at 2021-08-28 00:02:45 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.052: INFO: Container env-test ready: false, restart count 0 Aug 28 00:07:03.052: INFO: affinity-nodeport-nftrw started at 2021-08-28 00:05:40 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.052: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 28 00:07:03.052: INFO: kube-multus-ds-amd64-nn7bl started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.052: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:07:03.052: INFO: kubernetes-metrics-scraper-678c97765c-gtp5x started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.052: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 Aug 28 00:07:03.052: INFO: nginx-proxy-node1 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.052: INFO: Container nginx-proxy ready: true, restart count 2 Aug 28 00:07:03.052: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-9lndx started at 2021-08-27 20:55:51 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.052: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 28 00:07:03.052: INFO: node-exporter-4cvlq started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:07:03.052: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:07:03.052: INFO: Container node-exporter ready: true, restart count 0 Aug 28 00:07:03.052: INFO: busybox-user-65534-4e812def-5fed-4cb2-833c-b1b74115ed6d started at 2021-08-28 00:02:08 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.052: INFO: Container busybox-user-65534-4e812def-5fed-4cb2-833c-b1b74115ed6d ready: false, restart count 0 Aug 28 00:07:03.052: INFO: pod-subpath-test-configmap-ljw6 started at 2021-08-28 00:06:51 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.052: INFO: Container test-container-subpath-configmap-ljw6 ready: true, restart count 0 Aug 28 00:07:03.053: INFO: kubernetes-dashboard-86c6f9df5b-c56fg started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.053: INFO: Container kubernetes-dashboard ready: true, restart count 1 Aug 28 00:07:03.053: INFO: node-feature-discovery-worker-bd9kg started at 2021-08-27 20:55:06 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.053: INFO: Container nfd-worker ready: true, restart count 0 Aug 28 00:07:03.053: INFO: kube-proxy-pb5bl started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.053: INFO: Container kube-proxy ready: true, restart count 2 Aug 28 00:07:03.053: INFO: collectd-ccvwg started at 2021-08-27 21:04:15 +0000 UTC (0+3 container statuses recorded) Aug 28 00:07:03.053: INFO: Container collectd ready: true, restart count 0 Aug 28 00:07:03.053: INFO: Container collectd-exporter ready: true, restart count 0 Aug 28 00:07:03.053: INFO: Container rbac-proxy ready: true, restart count 0 Aug 28 00:07:03.053: INFO: foo-wxzlz started at 2021-08-27 23:57:13 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.053: INFO: Container c ready: false, restart count 0 Aug 28 00:07:03.053: INFO: prometheus-k8s-0 started at 2021-08-27 20:59:29 +0000 UTC (0+5 container statuses recorded) Aug 28 00:07:03.053: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 28 00:07:03.053: INFO: Container grafana ready: true, restart count 0 Aug 28 00:07:03.053: INFO: Container prometheus ready: true, restart count 1 Aug 28 00:07:03.053: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 28 00:07:03.053: INFO: Container rules-configmap-reloader ready: true, restart count 0 W0828 00:07:03.068331 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:07:03.097: INFO: Latency metrics for node node1 Aug 28 00:07:03.097: INFO: Logging node info for node node2 Aug 28 00:07:03.099: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eb7da7c0-513f-4072-a078-ad3d24f88114 69221 0 2021-08-27 20:48:09 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:88:9c:d1:39:68"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-27 20:48:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-27 20:48:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-27 20:58:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-27 20:58:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:50:36 +0000 UTC,LastTransitionTime:2021-08-27 20:50:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:07:03 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:07:03 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:07:03 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:07:03 +0000 UTC,LastTransitionTime:2021-08-27 20:48:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0ccfc2a4a9b7400c9ca53b5de0ca4970,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:26b02690-0814-4c92-9f6d-d315df796ce6,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:331c6faa8b0d5ec72cf105e87d35df0a2f2baeec3d6217a51faa73f9460f937f localhost:30500/barometer-collectd:stable],SizeBytes:1238704157,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[localhost:30500/cmk@sha256:fd1487b0c07556a087eff669e70c501a704720dcd53ff75183593de6720585f2 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:d7300ccf7ff3e9cea2111d275143b8050618bbc1d1ffe41f46286b1696261243 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44393508,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:ae72171f047a37ee5423e0692df7429830919af16e9d668ab0c80b723863d102 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:cd98d1edca8e5e2e3ea42cbc463812483e5d069d10f0974ca9d484b5a7bd68db localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:07:03.100: INFO: Logging kubelet events for node node2 Aug 28 00:07:03.103: INFO: Logging pods the kubelet thinks is on node node2 Aug 28 00:07:03.116: INFO: collectd-64dp2 started at 2021-08-27 21:04:15 +0000 UTC (0+3 container statuses recorded) Aug 28 00:07:03.116: INFO: Container collectd ready: true, restart count 0 Aug 28 00:07:03.116: INFO: Container collectd-exporter ready: true, restart count 0 Aug 28 00:07:03.116: INFO: Container rbac-proxy ready: true, restart count 0 Aug 28 00:07:03.116: INFO: execpod-affinityjrc5j started at 2021-08-28 00:05:55 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container agnhost-container ready: true, restart count 0 Aug 28 00:07:03.116: INFO: cmk-webhook-6c9d5f8578-ndbx2 started at 2021-08-27 20:58:20 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container cmk-webhook ready: true, restart count 0 Aug 28 00:07:03.116: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-v99df started at 2021-08-27 21:02:08 +0000 UTC (0+2 container statuses recorded) Aug 28 00:07:03.116: INFO: Container tas-controller ready: true, restart count 0 Aug 28 00:07:03.116: INFO: Container tas-extender ready: true, restart count 0 Aug 28 00:07:03.116: INFO: kube-flannel-t9qv4 started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:07:03.116: INFO: Container kube-flannel ready: true, restart count 2 Aug 28 00:07:03.116: INFO: cmk-init-discover-node2-l9qjd started at 2021-08-27 20:57:57 +0000 UTC (0+3 container statuses recorded) Aug 28 00:07:03.116: INFO: Container discover ready: false, restart count 0 Aug 28 00:07:03.116: INFO: Container init ready: false, restart count 0 Aug 28 00:07:03.116: INFO: Container install ready: false, restart count 0 Aug 28 00:07:03.116: INFO: liveness-0d0e184a-16e9-40a6-a9e6-c55adc80a942 started at 2021-08-28 00:06:02 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container liveness ready: true, restart count 0 Aug 28 00:07:03.116: INFO: affinity-clusterip-transition-ql92m started at 2021-08-28 00:06:37 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Aug 28 00:07:03.116: INFO: node-feature-discovery-worker-54lfh started at 2021-08-27 20:55:06 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container nfd-worker ready: true, restart count 0 Aug 28 00:07:03.116: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4f962 started at 2021-08-27 20:55:51 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 28 00:07:03.116: INFO: affinity-nodeport-p8hxs started at 2021-08-28 00:05:40 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 28 00:07:03.116: INFO: foo-qhqsk started at 2021-08-27 23:57:13 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container c ready: false, restart count 0 Aug 28 00:07:03.116: INFO: nginx-proxy-node2 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container nginx-proxy ready: true, restart count 1 Aug 28 00:07:03.116: INFO: kube-proxy-r4q4t started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container kube-proxy ready: true, restart count 2 Aug 28 00:07:03.116: INFO: kube-multus-ds-amd64-tfffk started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:07:03.116: INFO: node-exporter-p6h5h started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:07:03.116: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:07:03.116: INFO: Container node-exporter ready: true, restart count 0 Aug 28 00:07:03.116: INFO: busybox-privileged-false-90b48784-5dd2-427b-b747-6afc064ddd7a started at 2021-08-28 00:04:33 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container busybox-privileged-false-90b48784-5dd2-427b-b747-6afc064ddd7a ready: false, restart count 0 Aug 28 00:07:03.116: INFO: cmk-fzjgr started at 2021-08-27 20:58:20 +0000 UTC (0+2 container statuses recorded) Aug 28 00:07:03.116: INFO: Container nodereport ready: true, restart count 0 Aug 28 00:07:03.116: INFO: Container reconcile ready: true, restart count 0 Aug 28 00:07:03.116: INFO: affinity-nodeport-pxmnb started at 2021-08-28 00:05:40 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 28 00:07:03.116: INFO: busybox-readonly-fs4ff1ee3a-ef4c-4c58-b1a3-272770e65c5f started at 2021-08-28 00:05:57 +0000 UTC (0+1 container statuses recorded) Aug 28 00:07:03.116: INFO: Container busybox-readonly-fs4ff1ee3a-ef4c-4c58-b1a3-272770e65c5f ready: false, restart count 0 W0828 00:07:03.128050 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:07:03.156: INFO: Latency metrics for node node2 Aug 28 00:07:03.156: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "statefulset-5967" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 28 00:12:05.786: Unexpected error: <*errors.errorString | 0xc0029a15f0>: { s: "expected pod \"var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e\" success: Gave up after waiting 5m0s for pod \"var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e" success: Gave up after waiting 5m0s for pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 28 00:07:03.189: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should allow composing env vars into new env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test env composition Aug 28 00:07:03.222: INFO: Waiting up to 5m0s for pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e" in namespace "var-expansion-3204" to be "Succeeded or Failed" Aug 28 00:07:03.225: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3.349378ms Aug 28 00:07:05.229: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006719316s Aug 28 00:07:07.231: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009607214s Aug 28 00:07:09.235: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013264348s Aug 28 00:07:11.238: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 8.016380574s Aug 28 00:07:13.242: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 10.020120277s Aug 28 00:07:15.245: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 12.02280853s Aug 28 00:07:17.248: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 14.026248139s Aug 28 00:07:19.252: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 16.030526579s Aug 28 00:07:21.255: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 18.033575094s Aug 28 00:07:23.260: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 20.038014623s Aug 28 00:07:25.263: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 22.040950652s Aug 28 00:07:27.266: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 24.044127381s Aug 28 00:07:29.269: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 26.047134392s Aug 28 00:07:31.272: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 28.04969584s Aug 28 00:07:33.275: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 30.053064627s Aug 28 00:07:35.279: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 32.057015927s Aug 28 00:07:37.282: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 34.060324438s Aug 28 00:07:39.286: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 36.063929044s Aug 28 00:07:41.288: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 38.066545417s Aug 28 00:07:43.291: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 40.069396163s Aug 28 00:07:45.294: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 42.072431964s Aug 28 00:07:47.297: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 44.075572732s Aug 28 00:07:49.301: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 46.078835817s Aug 28 00:07:51.304: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 48.082304186s Aug 28 00:07:53.307: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 50.08496467s Aug 28 00:07:55.310: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 52.088463802s Aug 28 00:07:57.314: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 54.09172572s Aug 28 00:07:59.317: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 56.095193737s Aug 28 00:08:01.320: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 58.097757688s Aug 28 00:08:03.323: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.101049643s Aug 28 00:08:05.326: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.104161682s Aug 28 00:08:07.330: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.108517716s Aug 28 00:08:09.334: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.112107524s Aug 28 00:08:11.337: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.115673912s Aug 28 00:08:13.341: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.119248274s Aug 28 00:08:15.344: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.122136425s Aug 28 00:08:17.348: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.12606433s Aug 28 00:08:19.350: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.12854116s Aug 28 00:08:21.354: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.132041425s Aug 28 00:08:23.358: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.135796027s Aug 28 00:08:25.361: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.138916671s Aug 28 00:08:27.364: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.142160053s Aug 28 00:08:29.367: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.145570151s Aug 28 00:08:31.371: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.148755905s Aug 28 00:08:33.374: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.152394066s Aug 28 00:08:35.377: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.15473973s Aug 28 00:08:37.381: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.158894493s Aug 28 00:08:39.385: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.162766s Aug 28 00:08:41.388: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.166143198s Aug 28 00:08:43.392: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.170338957s Aug 28 00:08:45.396: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.174166085s Aug 28 00:08:47.399: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.177341993s Aug 28 00:08:49.402: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.180656308s Aug 28 00:08:51.406: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.183734292s Aug 28 00:08:53.410: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.18777147s Aug 28 00:08:55.412: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.190433381s Aug 28 00:08:57.416: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.193741016s Aug 28 00:08:59.421: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.198813506s Aug 28 00:09:01.425: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.202798871s Aug 28 00:09:03.428: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.206182236s Aug 28 00:09:05.432: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.210191623s Aug 28 00:09:07.435: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.213586316s Aug 28 00:09:09.439: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.217102982s Aug 28 00:09:11.444: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.222073015s Aug 28 00:09:13.450: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.227726779s Aug 28 00:09:15.453: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.230863288s Aug 28 00:09:17.457: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.235683027s Aug 28 00:09:19.464: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.242671807s Aug 28 00:09:21.467: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.245318917s Aug 28 00:09:23.474: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.252433844s Aug 28 00:09:25.477: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.255670767s Aug 28 00:09:27.482: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.260313702s Aug 28 00:09:29.486: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.264040742s Aug 28 00:09:31.489: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.267093151s Aug 28 00:09:33.496: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.274561875s Aug 28 00:09:35.500: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.278358486s Aug 28 00:09:37.504: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.282093482s Aug 28 00:09:39.509: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.286920105s Aug 28 00:09:41.511: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.289638329s Aug 28 00:09:43.514: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.292305738s Aug 28 00:09:45.518: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.295961308s Aug 28 00:09:47.522: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.299715234s Aug 28 00:09:49.530: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.308349434s Aug 28 00:09:51.533: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.311608317s Aug 28 00:09:53.536: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.314668329s Aug 28 00:09:55.539: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.317384131s Aug 28 00:09:57.543: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.32129539s Aug 28 00:09:59.551: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.329036601s Aug 28 00:10:01.554: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.332018776s Aug 28 00:10:03.558: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.335960302s Aug 28 00:10:05.561: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.33952045s Aug 28 00:10:07.564: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.342300184s Aug 28 00:10:09.567: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.345520768s Aug 28 00:10:11.570: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.348520196s Aug 28 00:10:13.573: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.351178393s Aug 28 00:10:15.576: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.353936004s Aug 28 00:10:17.579: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.357211449s Aug 28 00:10:19.583: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.360694039s Aug 28 00:10:21.585: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.363517074s Aug 28 00:10:23.590: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.368648645s Aug 28 00:10:25.594: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.372347173s Aug 28 00:10:27.598: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.376545495s Aug 28 00:10:29.602: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.379902871s Aug 28 00:10:31.606: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.38392979s Aug 28 00:10:33.609: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.387452327s Aug 28 00:10:35.613: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.391157417s Aug 28 00:10:37.616: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.394383913s Aug 28 00:10:39.620: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.397778311s Aug 28 00:10:41.623: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.400705986s Aug 28 00:10:43.630: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.407868504s Aug 28 00:10:45.632: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.410382238s Aug 28 00:10:47.635: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.413510578s Aug 28 00:10:49.639: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.41751052s Aug 28 00:10:51.644: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.422267259s Aug 28 00:10:53.648: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.42570826s Aug 28 00:10:55.651: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.429432457s Aug 28 00:10:57.654: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.43261273s Aug 28 00:10:59.659: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.436726705s Aug 28 00:11:01.662: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.440462656s Aug 28 00:11:03.666: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.444051909s Aug 28 00:11:05.670: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.448649929s Aug 28 00:11:07.673: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.450915374s Aug 28 00:11:09.677: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.455505591s Aug 28 00:11:11.681: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.458990072s Aug 28 00:11:13.684: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.462332744s Aug 28 00:11:15.689: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.466850308s Aug 28 00:11:17.692: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.470274276s Aug 28 00:11:19.696: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.474644922s Aug 28 00:11:21.700: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.477967539s Aug 28 00:11:23.705: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.483635622s Aug 28 00:11:25.709: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.487540932s Aug 28 00:11:27.713: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.490908579s Aug 28 00:11:29.716: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.494397678s Aug 28 00:11:31.719: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.496802889s Aug 28 00:11:33.722: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.500244619s Aug 28 00:11:35.725: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.50302813s Aug 28 00:11:37.729: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.506872678s Aug 28 00:11:39.732: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.51041516s Aug 28 00:11:41.735: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.513290768s Aug 28 00:11:43.738: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.516177329s Aug 28 00:11:45.741: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.518950801s Aug 28 00:11:47.744: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.522075919s Aug 28 00:11:49.747: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.525562276s Aug 28 00:11:51.751: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.528826187s Aug 28 00:11:53.753: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.531667652s Aug 28 00:11:55.756: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.534531255s Aug 28 00:11:57.759: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.537506581s Aug 28 00:11:59.764: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.542493346s Aug 28 00:12:01.768: INFO: Pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.546432025s Aug 28 00:12:03.774: INFO: Failed to get logs from node "node1" pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e" container "dapi-container": the server rejected our request for an unknown reason (get pods var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e) STEP: delete the pod Aug 28 00:12:03.781: INFO: Waiting for pod var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e to disappear Aug 28 00:12:03.782: INFO: Pod var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e still exists Aug 28 00:12:05.783: INFO: Waiting for pod var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e to disappear Aug 28 00:12:05.785: INFO: Pod var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e no longer exists Aug 28 00:12:05.786: FAIL: Unexpected error: <*errors.errorString | 0xc0029a15f0>: { s: "expected pod \"var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e\" success: Gave up after waiting 5m0s for pod \"var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e" success: Gave up after waiting 5m0s for pod "var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00106b760, 0x4c12453, 0xf, 0xc004334800, 0x0, 0xc0011ef1a8, 0x3, 0x3, 0x4df0110) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func9.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:58 +0x22a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0018a1e00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0018a1e00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0018a1e00, 0x4dec428) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-3204". STEP: Found 9 events. Aug 28 00:12:05.790: INFO: At 2021-08-28 00:07:03 +0000 UTC - event for var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e: {default-scheduler } Scheduled: Successfully assigned var-expansion-3204/var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e to node1 Aug 28 00:12:05.790: INFO: At 2021-08-28 00:07:04 +0000 UTC - event for var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e: {multus } AddedInterface: Add eth0 [10.244.3.75/24] Aug 28 00:12:05.790: INFO: At 2021-08-28 00:07:04 +0000 UTC - event for var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 28 00:12:05.790: INFO: At 2021-08-28 00:07:05 +0000 UTC - event for var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 28 00:12:05.790: INFO: At 2021-08-28 00:07:05 +0000 UTC - event for var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e: {kubelet node1} Failed: Error: ErrImagePull Aug 28 00:12:05.790: INFO: At 2021-08-28 00:07:05 +0000 UTC - event for var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 28 00:12:05.790: INFO: At 2021-08-28 00:07:07 +0000 UTC - event for var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e: {multus } AddedInterface: Add eth0 [10.244.3.76/24] Aug 28 00:12:05.790: INFO: At 2021-08-28 00:07:07 +0000 UTC - event for var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 28 00:12:05.790: INFO: At 2021-08-28 00:07:07 +0000 UTC - event for var-expansion-5297e858-64f9-4f37-8f24-be27ca5c0f6e: {kubelet node1} Failed: Error: ImagePullBackOff Aug 28 00:12:05.792: INFO: POD NODE PHASE GRACE CONDITIONS Aug 28 00:12:05.792: INFO: Aug 28 00:12:05.796: INFO: Logging node info for node master1 Aug 28 00:12:05.798: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 3af53387-5aee-42c1-b0e7-644cf9161d48 71893 0 2021-08-27 20:46:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"92:f8:b6:72:e4:be"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-27 20:46:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-27 20:46:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-08-27 20:46:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:50:56 +0000 UTC,LastTransitionTime:2021-08-27 20:50:56 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:05 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:05 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:05 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:12:05 +0000 UTC,LastTransitionTime:2021-08-27 20:50:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5d584023135a46ecb77596bf48ed7f2f,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:587cafa0-6de3-49f8-906e-06315a8ff104,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:ae72171f047a37ee5423e0692df7429830919af16e9d668ab0c80b723863d102 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:cd98d1edca8e5e2e3ea42cbc463812483e5d069d10f0974ca9d484b5a7bd68db tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:12:05.799: INFO: Logging kubelet events for node master1 Aug 28 00:12:05.801: INFO: Logging pods the kubelet thinks is on node master1 Aug 28 00:12:05.811: INFO: kube-scheduler-master1 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.811: INFO: Container kube-scheduler ready: true, restart count 0 Aug 28 00:12:05.811: INFO: kube-flannel-pp7vp started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:12:05.811: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:12:05.811: INFO: Container kube-flannel ready: true, restart count 3 Aug 28 00:12:05.811: INFO: kube-multus-ds-amd64-sfr9k started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.811: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:12:05.811: INFO: docker-registry-docker-registry-56cbc7bc58-cthtt started at 2021-08-27 20:51:47 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:05.811: INFO: Container docker-registry ready: true, restart count 0 Aug 28 00:12:05.811: INFO: Container nginx ready: true, restart count 0 Aug 28 00:12:05.811: INFO: kube-apiserver-master1 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.811: INFO: Container kube-apiserver ready: true, restart count 0 Aug 28 00:12:05.811: INFO: kube-controller-manager-master1 started at 2021-08-27 20:54:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.811: INFO: Container kube-controller-manager ready: true, restart count 3 Aug 28 00:12:05.811: INFO: kube-proxy-rb5p6 started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.811: INFO: Container kube-proxy ready: true, restart count 1 Aug 28 00:12:05.811: INFO: coredns-7677f9bb54-dwtp5 started at 2021-08-27 20:49:16 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.811: INFO: Container coredns ready: true, restart count 1 Aug 28 00:12:05.811: INFO: node-exporter-z2ngr started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:05.811: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:12:05.811: INFO: Container node-exporter ready: true, restart count 0 W0828 00:12:05.822937 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:12:05.848: INFO: Latency metrics for node master1 Aug 28 00:12:05.848: INFO: Logging node info for node master2 Aug 28 00:12:05.850: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 666e473f-d9e6-4c06-8b56-06474d788f70 71882 0 2021-08-27 20:46:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"42:86:ff:30:bd:4d"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-27 20:46:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-27 20:46:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-27 20:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:53 +0000 UTC,LastTransitionTime:2021-08-27 20:51:53 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:03 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:03 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:03 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:12:03 +0000 UTC,LastTransitionTime:2021-08-27 20:48:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2835065974a64998811b9acd85de209b,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:309b9155-1e2a-4ebd-900f-bba5abfc3a5d,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:12:05.851: INFO: Logging kubelet events for node master2 Aug 28 00:12:05.853: INFO: Logging pods the kubelet thinks is on node master2 Aug 28 00:12:05.861: INFO: kube-apiserver-master2 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.861: INFO: Container kube-apiserver ready: true, restart count 0 Aug 28 00:12:05.861: INFO: kube-scheduler-master2 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.861: INFO: Container kube-scheduler ready: true, restart count 2 Aug 28 00:12:05.861: INFO: kube-proxy-b4mn9 started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.861: INFO: Container kube-proxy ready: true, restart count 1 Aug 28 00:12:05.861: INFO: node-feature-discovery-controller-5bf5c49849-zr9zd started at 2021-08-27 20:55:09 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.861: INFO: Container nfd-controller ready: true, restart count 0 Aug 28 00:12:05.861: INFO: kube-controller-manager-master2 started at 2021-08-27 20:51:01 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.861: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 28 00:12:05.861: INFO: kube-flannel-4znnq started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:12:05.861: INFO: Init container install-cni ready: true, restart count 2 Aug 28 00:12:05.861: INFO: Container kube-flannel ready: true, restart count 2 Aug 28 00:12:05.861: INFO: kube-multus-ds-amd64-4mgbk started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.861: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:12:05.861: INFO: prometheus-operator-5bb8cb9d8f-whr5p started at 2021-08-27 20:59:06 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:05.861: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:12:05.861: INFO: Container prometheus-operator ready: true, restart count 0 Aug 28 00:12:05.861: INFO: node-exporter-96jk5 started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:05.861: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:12:05.862: INFO: Container node-exporter ready: true, restart count 0 W0828 00:12:05.875146 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:12:05.906: INFO: Latency metrics for node master2 Aug 28 00:12:05.906: INFO: Logging node info for node master3 Aug 28 00:12:05.908: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 620b6dba-f2c5-46e9-b2ff-d2f4197167d0 71874 0 2021-08-27 20:47:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ce:de:ea:c3:40:4f"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-27 20:47:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-27 20:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-27 20:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:44 +0000 UTC,LastTransitionTime:2021-08-27 20:51:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:02 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:02 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:02 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:12:02 +0000 UTC,LastTransitionTime:2021-08-27 20:48:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:37decbffe0e84048b5801289ad3be5bf,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:c96fe8b9-1ce0-44cd-935a-b58987e26570,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496891,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:12:05.909: INFO: Logging kubelet events for node master3 Aug 28 00:12:05.910: INFO: Logging pods the kubelet thinks is on node master3 Aug 28 00:12:05.919: INFO: kube-proxy-8sxhm started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.919: INFO: Container kube-proxy ready: true, restart count 1 Aug 28 00:12:05.919: INFO: kube-flannel-fkz5d started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:12:05.919: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:12:05.919: INFO: Container kube-flannel ready: true, restart count 1 Aug 28 00:12:05.919: INFO: dns-autoscaler-5b7b5c9b6f-54xch started at 2021-08-27 20:49:19 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.919: INFO: Container autoscaler ready: true, restart count 1 Aug 28 00:12:05.919: INFO: coredns-7677f9bb54-rxplt started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.919: INFO: Container coredns ready: true, restart count 1 Aug 28 00:12:05.919: INFO: kube-controller-manager-master3 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.919: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 28 00:12:05.919: INFO: kube-scheduler-master3 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.919: INFO: Container kube-scheduler ready: true, restart count 2 Aug 28 00:12:05.919: INFO: kube-multus-ds-amd64-wwcgv started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.919: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:12:05.919: INFO: node-exporter-d4m7q started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:05.919: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:12:05.919: INFO: Container node-exporter ready: true, restart count 0 Aug 28 00:12:05.919: INFO: kube-apiserver-master3 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.919: INFO: Container kube-apiserver ready: true, restart count 0 W0828 00:12:05.930441 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:12:05.962: INFO: Latency metrics for node master3 Aug 28 00:12:05.962: INFO: Logging node info for node node1 Aug 28 00:12:05.965: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 e7a2481e-32db-4c83-bd9f-4a0687258e7a 71868 0 2021-08-27 20:48:09 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"56:c7:37:40:51:ca"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-27 20:48:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-27 20:48:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-27 20:57:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-27 20:57:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:49 +0000 UTC,LastTransitionTime:2021-08-27 20:51:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:00 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:00 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:00 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:12:00 +0000 UTC,LastTransitionTime:2021-08-27 20:48:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c1e38e80ea114a5f96601202301ce842,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:e769e86d-15c0-442c-a93b-bcc6c33ff1cd,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:331c6faa8b0d5ec72cf105e87d35df0a2f2baeec3d6217a51faa73f9460f937f localhost:30500/barometer-collectd:stable],SizeBytes:1238704157,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1003787960,},ContainerImage{Names:[localhost:30500/cmk@sha256:fd1487b0c07556a087eff669e70c501a704720dcd53ff75183593de6720585f2 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:d7300ccf7ff3e9cea2111d275143b8050618bbc1d1ffe41f46286b1696261243 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44393508,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:12:05.966: INFO: Logging kubelet events for node node1 Aug 28 00:12:05.968: INFO: Logging pods the kubelet thinks is on node node1 Aug 28 00:12:05.984: INFO: nginx-proxy-node1 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.984: INFO: Container nginx-proxy ready: true, restart count 2 Aug 28 00:12:05.984: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-9lndx started at 2021-08-27 20:55:51 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.984: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 28 00:12:05.984: INFO: webserver-deployment-dd94f59b7-56q7x started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.984: INFO: Container httpd ready: false, restart count 0 Aug 28 00:12:05.984: INFO: webserver-deployment-dd94f59b7-f4kxs started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.984: INFO: Container httpd ready: false, restart count 0 Aug 28 00:12:05.984: INFO: node-exporter-4cvlq started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:05.984: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:12:05.984: INFO: Container node-exporter ready: true, restart count 0 Aug 28 00:12:05.984: INFO: var-expansion-c588bc90-2b5d-4887-b768-04f3a7490adc started at 2021-08-28 00:11:25 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.984: INFO: Container dapi-container ready: false, restart count 0 Aug 28 00:12:05.985: INFO: kubernetes-dashboard-86c6f9df5b-c56fg started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Container kubernetes-dashboard ready: true, restart count 1 Aug 28 00:12:05.985: INFO: node-feature-discovery-worker-bd9kg started at 2021-08-27 20:55:06 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Container nfd-worker ready: true, restart count 0 Aug 28 00:12:05.985: INFO: pod-configmaps-b72f648b-a248-483c-a3c6-74fd04030e7a started at 2021-08-28 00:07:20 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:05.985: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Aug 28 00:12:05.985: INFO: Container configmap-volume-data-test ready: false, restart count 0 Aug 28 00:12:05.985: INFO: webserver-deployment-dd94f59b7-bv7w9 started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Container httpd ready: false, restart count 0 Aug 28 00:12:05.985: INFO: kube-proxy-pb5bl started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Container kube-proxy ready: true, restart count 2 Aug 28 00:12:05.985: INFO: collectd-ccvwg started at 2021-08-27 21:04:15 +0000 UTC (0+3 container statuses recorded) Aug 28 00:12:05.985: INFO: Container collectd ready: true, restart count 0 Aug 28 00:12:05.985: INFO: Container collectd-exporter ready: true, restart count 0 Aug 28 00:12:05.985: INFO: Container rbac-proxy ready: true, restart count 0 Aug 28 00:12:05.985: INFO: prometheus-k8s-0 started at 2021-08-27 20:59:29 +0000 UTC (0+5 container statuses recorded) Aug 28 00:12:05.985: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 28 00:12:05.985: INFO: Container grafana ready: true, restart count 0 Aug 28 00:12:05.985: INFO: Container prometheus ready: true, restart count 1 Aug 28 00:12:05.985: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 28 00:12:05.985: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 28 00:12:05.985: INFO: adopt-release-s6jg4 started at 2021-08-28 00:07:35 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Container c ready: false, restart count 0 Aug 28 00:12:05.985: INFO: foo-wxzlz started at 2021-08-27 23:57:13 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Container c ready: false, restart count 0 Aug 28 00:12:05.985: INFO: webserver-deployment-dd94f59b7-wnjgv started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Container httpd ready: false, restart count 0 Aug 28 00:12:05.985: INFO: kube-flannel-ssxn7 started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:12:05.985: INFO: Container kube-flannel ready: true, restart count 1 Aug 28 00:12:05.985: INFO: webserver-deployment-dd94f59b7-hddhg started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Container httpd ready: false, restart count 0 Aug 28 00:12:05.985: INFO: kube-multus-ds-amd64-nn7bl started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:12:05.985: INFO: kubernetes-metrics-scraper-678c97765c-gtp5x started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:05.985: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 Aug 28 00:12:05.985: INFO: cmk-init-discover-node1-spg26 started at 2021-08-27 20:57:37 +0000 UTC (0+3 container statuses recorded) Aug 28 00:12:05.985: INFO: Container discover ready: false, restart count 0 Aug 28 00:12:05.985: INFO: Container init ready: false, restart count 0 Aug 28 00:12:05.985: INFO: Container install ready: false, restart count 0 Aug 28 00:12:05.985: INFO: cmk-jw4m6 started at 2021-08-27 20:58:19 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:05.985: INFO: Container nodereport ready: true, restart count 0 Aug 28 00:12:05.985: INFO: Container reconcile ready: true, restart count 0 W0828 00:12:05.998216 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:12:06.044: INFO: Latency metrics for node node1 Aug 28 00:12:06.044: INFO: Logging node info for node node2 Aug 28 00:12:06.048: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eb7da7c0-513f-4072-a078-ad3d24f88114 71894 0 2021-08-27 20:48:09 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:88:9c:d1:39:68"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-27 20:48:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-27 20:48:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-27 20:58:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-27 20:58:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:50:36 +0000 UTC,LastTransitionTime:2021-08-27 20:50:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:05 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:05 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:12:05 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:12:05 +0000 UTC,LastTransitionTime:2021-08-27 20:48:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0ccfc2a4a9b7400c9ca53b5de0ca4970,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:26b02690-0814-4c92-9f6d-d315df796ce6,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:331c6faa8b0d5ec72cf105e87d35df0a2f2baeec3d6217a51faa73f9460f937f localhost:30500/barometer-collectd:stable],SizeBytes:1238704157,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[localhost:30500/cmk@sha256:fd1487b0c07556a087eff669e70c501a704720dcd53ff75183593de6720585f2 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:d7300ccf7ff3e9cea2111d275143b8050618bbc1d1ffe41f46286b1696261243 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44393508,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:ae72171f047a37ee5423e0692df7429830919af16e9d668ab0c80b723863d102 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:cd98d1edca8e5e2e3ea42cbc463812483e5d069d10f0974ca9d484b5a7bd68db localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:12:06.049: INFO: Logging kubelet events for node node2 Aug 28 00:12:06.051: INFO: Logging pods the kubelet thinks is on node node2 Aug 28 00:12:06.065: INFO: node-exporter-p6h5h started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:06.065: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:12:06.065: INFO: Container node-exporter ready: true, restart count 0 Aug 28 00:12:06.065: INFO: nginx-proxy-node2 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container nginx-proxy ready: true, restart count 1 Aug 28 00:12:06.065: INFO: kube-proxy-r4q4t started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container kube-proxy ready: true, restart count 2 Aug 28 00:12:06.065: INFO: kube-multus-ds-amd64-tfffk started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:12:06.065: INFO: termination-message-containerf5986240-8f49-4b9c-b2e3-7702c8d9ced1 started at 2021-08-28 00:07:48 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container termination-message-container ready: false, restart count 0 Aug 28 00:12:06.065: INFO: webserver-deployment-dd94f59b7-rl54s started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container httpd ready: false, restart count 0 Aug 28 00:12:06.065: INFO: downward-api-c9653810-7bb3-4aad-bed1-588d15cecffc started at 2021-08-28 00:10:18 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container dapi-container ready: false, restart count 0 Aug 28 00:12:06.065: INFO: cmk-fzjgr started at 2021-08-27 20:58:20 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:06.065: INFO: Container nodereport ready: true, restart count 0 Aug 28 00:12:06.065: INFO: Container reconcile ready: true, restart count 0 Aug 28 00:12:06.065: INFO: webserver-deployment-dd94f59b7-77lh5 started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container httpd ready: false, restart count 0 Aug 28 00:12:06.065: INFO: adopt-release-thh76 started at 2021-08-28 00:07:35 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container c ready: false, restart count 0 Aug 28 00:12:06.065: INFO: pod-update-activedeadlineseconds-1307540e-0d68-4e42-be9b-24f48a89a9da started at 2021-08-28 00:08:29 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container nginx ready: false, restart count 0 Aug 28 00:12:06.065: INFO: webserver-deployment-dd94f59b7-2z9dr started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container httpd ready: false, restart count 0 Aug 28 00:12:06.065: INFO: webserver-deployment-dd94f59b7-ntnc5 started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container httpd ready: false, restart count 0 Aug 28 00:12:06.065: INFO: collectd-64dp2 started at 2021-08-27 21:04:15 +0000 UTC (0+3 container statuses recorded) Aug 28 00:12:06.065: INFO: Container collectd ready: true, restart count 0 Aug 28 00:12:06.065: INFO: Container collectd-exporter ready: true, restart count 0 Aug 28 00:12:06.065: INFO: Container rbac-proxy ready: true, restart count 0 Aug 28 00:12:06.065: INFO: cmk-webhook-6c9d5f8578-ndbx2 started at 2021-08-27 20:58:20 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container cmk-webhook ready: true, restart count 0 Aug 28 00:12:06.065: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-v99df started at 2021-08-27 21:02:08 +0000 UTC (0+2 container statuses recorded) Aug 28 00:12:06.065: INFO: Container tas-controller ready: true, restart count 0 Aug 28 00:12:06.065: INFO: Container tas-extender ready: true, restart count 0 Aug 28 00:12:06.065: INFO: kube-flannel-t9qv4 started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:12:06.065: INFO: Container kube-flannel ready: true, restart count 2 Aug 28 00:12:06.065: INFO: cmk-init-discover-node2-l9qjd started at 2021-08-27 20:57:57 +0000 UTC (0+3 container statuses recorded) Aug 28 00:12:06.065: INFO: Container discover ready: false, restart count 0 Aug 28 00:12:06.065: INFO: Container init ready: false, restart count 0 Aug 28 00:12:06.065: INFO: Container install ready: false, restart count 0 Aug 28 00:12:06.065: INFO: foo-qhqsk started at 2021-08-27 23:57:13 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container c ready: false, restart count 0 Aug 28 00:12:06.065: INFO: node-feature-discovery-worker-54lfh started at 2021-08-27 20:55:06 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container nfd-worker ready: true, restart count 0 Aug 28 00:12:06.065: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4f962 started at 2021-08-27 20:55:51 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 28 00:12:06.065: INFO: webserver-deployment-dd94f59b7-4jn4k started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:12:06.065: INFO: Container httpd ready: false, restart count 0 W0828 00:12:06.078656 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:12:06.124: INFO: Latency metrics for node node2 Aug 28 00:12:06.124: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-3204" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 28 00:14:34.753: Unexpected error: <*errors.errorString | 0xc0009ee0d0>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32399 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32399 over TCP protocol occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 28 00:12:22.232: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service in namespace services-7164 STEP: creating service affinity-nodeport-transition in namespace services-7164 STEP: creating replication controller affinity-nodeport-transition in namespace services-7164 I0828 00:12:22.268401 29 runners.go:190] Created replication controller with name: affinity-nodeport-transition, namespace: services-7164, replica count: 3 I0828 00:12:25.318879 29 runners.go:190] affinity-nodeport-transition Pods: 3 out of 3 created, 0 running, 3 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0828 00:12:28.320146 29 runners.go:190] affinity-nodeport-transition Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 28 00:12:28.327: INFO: Creating new exec pod Aug 28 00:12:33.350: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 affinity-nodeport-transition 80' Aug 28 00:12:33.659: INFO: stderr: "+ nc -zv -t -w 2 affinity-nodeport-transition 80\nConnection to affinity-nodeport-transition 80 port [tcp/http] succeeded!\n" Aug 28 00:12:33.659: INFO: stdout: "" Aug 28 00:12:33.660: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.233.12.4 80' Aug 28 00:12:33.941: INFO: stderr: "+ nc -zv -t -w 2 10.233.12.4 80\nConnection to 10.233.12.4 80 port [tcp/http] succeeded!\n" Aug 28 00:12:33.941: INFO: stdout: "" Aug 28 00:12:33.941: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:34.222: INFO: rc: 1 Aug 28 00:12:34.222: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:35.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:35.481: INFO: rc: 1 Aug 28 00:12:35.481: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:36.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:36.477: INFO: rc: 1 Aug 28 00:12:36.477: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:37.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:37.492: INFO: rc: 1 Aug 28 00:12:37.492: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:38.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:38.468: INFO: rc: 1 Aug 28 00:12:38.468: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:39.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:39.486: INFO: rc: 1 Aug 28 00:12:39.486: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:40.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:40.480: INFO: rc: 1 Aug 28 00:12:40.480: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:41.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:41.479: INFO: rc: 1 Aug 28 00:12:41.479: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:42.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:42.496: INFO: rc: 1 Aug 28 00:12:42.496: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:43.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:43.460: INFO: rc: 1 Aug 28 00:12:43.460: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:44.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:45.487: INFO: rc: 1 Aug 28 00:12:45.487: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:46.224: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:46.492: INFO: rc: 1 Aug 28 00:12:46.492: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:47.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:47.524: INFO: rc: 1 Aug 28 00:12:47.524: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:48.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:48.475: INFO: rc: 1 Aug 28 00:12:48.475: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:49.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:49.486: INFO: rc: 1 Aug 28 00:12:49.486: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:50.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:50.571: INFO: rc: 1 Aug 28 00:12:50.571: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:51.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:51.468: INFO: rc: 1 Aug 28 00:12:51.468: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:52.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:52.498: INFO: rc: 1 Aug 28 00:12:52.498: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:53.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:53.508: INFO: rc: 1 Aug 28 00:12:53.508: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:54.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:54.494: INFO: rc: 1 Aug 28 00:12:54.494: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:55.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:55.479: INFO: rc: 1 Aug 28 00:12:55.479: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:56.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:56.494: INFO: rc: 1 Aug 28 00:12:56.494: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:57.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:57.465: INFO: rc: 1 Aug 28 00:12:57.465: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:58.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:58.494: INFO: rc: 1 Aug 28 00:12:58.494: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:12:59.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:12:59.934: INFO: rc: 1 Aug 28 00:12:59.934: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:00.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:00.505: INFO: rc: 1 Aug 28 00:13:00.505: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:01.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:01.494: INFO: rc: 1 Aug 28 00:13:01.494: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:02.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:02.538: INFO: rc: 1 Aug 28 00:13:02.538: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:03.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:03.473: INFO: rc: 1 Aug 28 00:13:03.473: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:04.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:04.473: INFO: rc: 1 Aug 28 00:13:04.473: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:05.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:05.902: INFO: rc: 1 Aug 28 00:13:05.902: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:06.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:06.853: INFO: rc: 1 Aug 28 00:13:06.853: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:07.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:07.650: INFO: rc: 1 Aug 28 00:13:07.650: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:08.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:08.488: INFO: rc: 1 Aug 28 00:13:08.488: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:09.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:09.514: INFO: rc: 1 Aug 28 00:13:09.514: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:10.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:10.619: INFO: rc: 1 Aug 28 00:13:10.619: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:11.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:11.652: INFO: rc: 1 Aug 28 00:13:11.652: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:12.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:12.496: INFO: rc: 1 Aug 28 00:13:12.496: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:13.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:13.503: INFO: rc: 1 Aug 28 00:13:13.503: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:14.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:15.408: INFO: rc: 1 Aug 28 00:13:15.408: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:16.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:16.553: INFO: rc: 1 Aug 28 00:13:16.553: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:17.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:17.485: INFO: rc: 1 Aug 28 00:13:17.485: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:18.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:18.520: INFO: rc: 1 Aug 28 00:13:18.520: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:19.224: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:19.510: INFO: rc: 1 Aug 28 00:13:19.510: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:20.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:20.467: INFO: rc: 1 Aug 28 00:13:20.468: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:21.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:21.479: INFO: rc: 1 Aug 28 00:13:21.479: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:22.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:22.502: INFO: rc: 1 Aug 28 00:13:22.502: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:23.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:23.482: INFO: rc: 1 Aug 28 00:13:23.482: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:24.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:24.478: INFO: rc: 1 Aug 28 00:13:24.478: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:25.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:25.468: INFO: rc: 1 Aug 28 00:13:25.468: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:26.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:26.476: INFO: rc: 1 Aug 28 00:13:26.476: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:27.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:27.558: INFO: rc: 1 Aug 28 00:13:27.558: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:28.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:28.510: INFO: rc: 1 Aug 28 00:13:28.510: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:29.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:29.488: INFO: rc: 1 Aug 28 00:13:29.488: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:30.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:30.501: INFO: rc: 1 Aug 28 00:13:30.501: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:31.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:31.486: INFO: rc: 1 Aug 28 00:13:31.486: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:32.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:32.494: INFO: rc: 1 Aug 28 00:13:32.494: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:33.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:33.599: INFO: rc: 1 Aug 28 00:13:33.599: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:34.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:34.448: INFO: rc: 1 Aug 28 00:13:34.448: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:35.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:35.501: INFO: rc: 1 Aug 28 00:13:35.501: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:36.224: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:36.492: INFO: rc: 1 Aug 28 00:13:36.492: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:37.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:37.493: INFO: rc: 1 Aug 28 00:13:37.494: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:38.224: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:38.459: INFO: rc: 1 Aug 28 00:13:38.459: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:39.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:39.481: INFO: rc: 1 Aug 28 00:13:39.481: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:40.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:40.498: INFO: rc: 1 Aug 28 00:13:40.498: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:41.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:41.473: INFO: rc: 1 Aug 28 00:13:41.473: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:42.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:42.475: INFO: rc: 1 Aug 28 00:13:42.475: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:43.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:43.475: INFO: rc: 1 Aug 28 00:13:43.475: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:44.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:45.585: INFO: rc: 1 Aug 28 00:13:45.586: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:46.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:46.478: INFO: rc: 1 Aug 28 00:13:46.478: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:47.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:47.486: INFO: rc: 1 Aug 28 00:13:47.487: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:48.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:48.480: INFO: rc: 1 Aug 28 00:13:48.480: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:49.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:49.508: INFO: rc: 1 Aug 28 00:13:49.508: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:50.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:50.495: INFO: rc: 1 Aug 28 00:13:50.495: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:51.224: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:51.482: INFO: rc: 1 Aug 28 00:13:51.482: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:52.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:52.496: INFO: rc: 1 Aug 28 00:13:52.496: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:53.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:53.499: INFO: rc: 1 Aug 28 00:13:53.499: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:54.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:54.502: INFO: rc: 1 Aug 28 00:13:54.502: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:55.224: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:55.491: INFO: rc: 1 Aug 28 00:13:55.491: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:56.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:56.491: INFO: rc: 1 Aug 28 00:13:56.491: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:57.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:57.490: INFO: rc: 1 Aug 28 00:13:57.490: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:58.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:58.503: INFO: rc: 1 Aug 28 00:13:58.503: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:13:59.224: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:13:59.492: INFO: rc: 1 Aug 28 00:13:59.492: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:00.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:00.490: INFO: rc: 1 Aug 28 00:14:00.490: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:01.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:01.482: INFO: rc: 1 Aug 28 00:14:01.483: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:02.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:02.500: INFO: rc: 1 Aug 28 00:14:02.500: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:03.224: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:03.500: INFO: rc: 1 Aug 28 00:14:03.500: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:04.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:04.492: INFO: rc: 1 Aug 28 00:14:04.492: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:05.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:05.484: INFO: rc: 1 Aug 28 00:14:05.484: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:06.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:06.471: INFO: rc: 1 Aug 28 00:14:06.471: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:07.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:07.475: INFO: rc: 1 Aug 28 00:14:07.475: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:08.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:08.504: INFO: rc: 1 Aug 28 00:14:08.504: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:09.224: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:09.479: INFO: rc: 1 Aug 28 00:14:09.479: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:10.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:10.512: INFO: rc: 1 Aug 28 00:14:10.512: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:11.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:11.489: INFO: rc: 1 Aug 28 00:14:11.489: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:12.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:12.492: INFO: rc: 1 Aug 28 00:14:12.492: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:13.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:13.502: INFO: rc: 1 Aug 28 00:14:13.502: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:14.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:15.538: INFO: rc: 1 Aug 28 00:14:15.538: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:16.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:16.507: INFO: rc: 1 Aug 28 00:14:16.507: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:17.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:17.486: INFO: rc: 1 Aug 28 00:14:17.486: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:18.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:18.488: INFO: rc: 1 Aug 28 00:14:18.488: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:19.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:19.500: INFO: rc: 1 Aug 28 00:14:19.500: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:20.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:20.488: INFO: rc: 1 Aug 28 00:14:20.488: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:21.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:21.488: INFO: rc: 1 Aug 28 00:14:21.489: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:22.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:22.487: INFO: rc: 1 Aug 28 00:14:22.487: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:23.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:23.489: INFO: rc: 1 Aug 28 00:14:23.489: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:24.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:24.523: INFO: rc: 1 Aug 28 00:14:24.523: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:25.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:25.472: INFO: rc: 1 Aug 28 00:14:25.472: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:26.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:26.508: INFO: rc: 1 Aug 28 00:14:26.508: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:27.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:27.472: INFO: rc: 1 Aug 28 00:14:27.472: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:28.224: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:28.496: INFO: rc: 1 Aug 28 00:14:28.496: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:29.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:29.507: INFO: rc: 1 Aug 28 00:14:29.507: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:30.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:30.500: INFO: rc: 1 Aug 28 00:14:30.500: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:31.222: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:31.471: INFO: rc: 1 Aug 28 00:14:31.471: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:32.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:32.483: INFO: rc: 1 Aug 28 00:14:32.483: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:33.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:33.481: INFO: rc: 1 Aug 28 00:14:33.481: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:34.223: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:34.495: INFO: rc: 1 Aug 28 00:14:34.495: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:34.495: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399' Aug 28 00:14:34.752: INFO: rc: 1 Aug 28 00:14:34.752: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7164 exec execpod-affinityf5mz2 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32399: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32399 nc: connect to 10.10.190.207 port 32399 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 28 00:14:34.753: FAIL: Unexpected error: <*errors.errorString | 0xc0009ee0d0>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32399 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32399 over TCP protocol occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithOptionalTransition(0xc00004fa20, 0x5411460, 0xc004b40c60, 0xc000a8eb40, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 +0x62e k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithTransition(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3466 k8s.io/kubernetes/test/e2e/network.glob..func24.30() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2541 +0xa5 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0018a1e00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0018a1e00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0018a1e00, 0x4dec428) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 Aug 28 00:14:34.754: INFO: Cleaning up the exec pod STEP: deleting ReplicationController affinity-nodeport-transition in namespace services-7164, will wait for the garbage collector to delete the pods Aug 28 00:14:34.833: INFO: Deleting ReplicationController affinity-nodeport-transition took: 4.500134ms Aug 28 00:14:35.534: INFO: Terminating ReplicationController affinity-nodeport-transition pods took: 700.483327ms [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "services-7164". STEP: Found 31 events. Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:22 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-zf6q8 Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:22 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-6z5pl Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:22 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-6zf6c Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:22 +0000 UTC - event for affinity-nodeport-transition-6z5pl: {default-scheduler } Scheduled: Successfully assigned services-7164/affinity-nodeport-transition-6z5pl to node2 Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:22 +0000 UTC - event for affinity-nodeport-transition-6zf6c: {default-scheduler } Scheduled: Successfully assigned services-7164/affinity-nodeport-transition-6zf6c to node1 Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:22 +0000 UTC - event for affinity-nodeport-transition-zf6q8: {default-scheduler } Scheduled: Successfully assigned services-7164/affinity-nodeport-transition-zf6q8 to node2 Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:24 +0000 UTC - event for affinity-nodeport-transition-6z5pl: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:24 +0000 UTC - event for affinity-nodeport-transition-6z5pl: {multus } AddedInterface: Add eth0 [10.244.4.156/24] Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:24 +0000 UTC - event for affinity-nodeport-transition-6zf6c: {multus } AddedInterface: Add eth0 [10.244.3.100/24] Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:24 +0000 UTC - event for affinity-nodeport-transition-6zf6c: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:24 +0000 UTC - event for affinity-nodeport-transition-6zf6c: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 473.718462ms Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:24 +0000 UTC - event for affinity-nodeport-transition-6zf6c: {kubelet node1} Created: Created container affinity-nodeport-transition Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:24 +0000 UTC - event for affinity-nodeport-transition-zf6q8: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:24 +0000 UTC - event for affinity-nodeport-transition-zf6q8: {multus } AddedInterface: Add eth0 [10.244.4.157/24] Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:25 +0000 UTC - event for affinity-nodeport-transition-6z5pl: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 626.422913ms Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:25 +0000 UTC - event for affinity-nodeport-transition-6zf6c: {kubelet node1} Started: Started container affinity-nodeport-transition Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:26 +0000 UTC - event for affinity-nodeport-transition-6z5pl: {kubelet node2} Created: Created container affinity-nodeport-transition Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:26 +0000 UTC - event for affinity-nodeport-transition-6z5pl: {kubelet node2} Started: Started container affinity-nodeport-transition Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:26 +0000 UTC - event for affinity-nodeport-transition-zf6q8: {kubelet node2} Created: Created container affinity-nodeport-transition Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:26 +0000 UTC - event for affinity-nodeport-transition-zf6q8: {kubelet node2} Started: Started container affinity-nodeport-transition Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:26 +0000 UTC - event for affinity-nodeport-transition-zf6q8: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 1.136175651s Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:28 +0000 UTC - event for execpod-affinityf5mz2: {default-scheduler } Scheduled: Successfully assigned services-7164/execpod-affinityf5mz2 to node2 Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:29 +0000 UTC - event for execpod-affinityf5mz2: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:29 +0000 UTC - event for execpod-affinityf5mz2: {multus } AddedInterface: Add eth0 [10.244.4.159/24] Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:30 +0000 UTC - event for execpod-affinityf5mz2: {kubelet node2} Created: Created container agnhost-container Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:30 +0000 UTC - event for execpod-affinityf5mz2: {kubelet node2} Started: Started container agnhost-container Aug 28 00:14:46.453: INFO: At 2021-08-28 00:12:30 +0000 UTC - event for execpod-affinityf5mz2: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 490.63551ms Aug 28 00:14:46.453: INFO: At 2021-08-28 00:14:34 +0000 UTC - event for execpod-affinityf5mz2: {kubelet node2} Killing: Stopping container agnhost-container Aug 28 00:14:46.453: INFO: At 2021-08-28 00:14:35 +0000 UTC - event for affinity-nodeport-transition-6z5pl: {kubelet node2} Killing: Stopping container affinity-nodeport-transition Aug 28 00:14:46.453: INFO: At 2021-08-28 00:14:35 +0000 UTC - event for affinity-nodeport-transition-6zf6c: {kubelet node1} Killing: Stopping container affinity-nodeport-transition Aug 28 00:14:46.453: INFO: At 2021-08-28 00:14:35 +0000 UTC - event for affinity-nodeport-transition-zf6q8: {kubelet node2} Killing: Stopping container affinity-nodeport-transition Aug 28 00:14:46.455: INFO: POD NODE PHASE GRACE CONDITIONS Aug 28 00:14:46.455: INFO: Aug 28 00:14:46.460: INFO: Logging node info for node master1 Aug 28 00:14:46.462: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 3af53387-5aee-42c1-b0e7-644cf9161d48 75550 0 2021-08-27 20:46:13 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"92:f8:b6:72:e4:be"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-27 20:46:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-27 20:46:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kube-controller-manager Update v1 2021-08-27 20:46:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:50:56 +0000 UTC,LastTransitionTime:2021-08-27 20:50:56 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:45 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:45 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:45 +0000 UTC,LastTransitionTime:2021-08-27 20:46:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:14:45 +0000 UTC,LastTransitionTime:2021-08-27 20:50:30 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5d584023135a46ecb77596bf48ed7f2f,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:587cafa0-6de3-49f8-906e-06315a8ff104,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:ae72171f047a37ee5423e0692df7429830919af16e9d668ab0c80b723863d102 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:cd98d1edca8e5e2e3ea42cbc463812483e5d069d10f0974ca9d484b5a7bd68db tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:14:46.463: INFO: Logging kubelet events for node master1 Aug 28 00:14:46.465: INFO: Logging pods the kubelet thinks is on node master1 Aug 28 00:14:46.474: INFO: kube-scheduler-master1 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.474: INFO: Container kube-scheduler ready: true, restart count 0 Aug 28 00:14:46.474: INFO: kube-flannel-pp7vp started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:14:46.474: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:14:46.474: INFO: Container kube-flannel ready: true, restart count 3 Aug 28 00:14:46.474: INFO: kube-multus-ds-amd64-sfr9k started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.474: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:14:46.474: INFO: docker-registry-docker-registry-56cbc7bc58-cthtt started at 2021-08-27 20:51:47 +0000 UTC (0+2 container statuses recorded) Aug 28 00:14:46.474: INFO: Container docker-registry ready: true, restart count 0 Aug 28 00:14:46.474: INFO: Container nginx ready: true, restart count 0 Aug 28 00:14:46.474: INFO: node-exporter-z2ngr started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:14:46.474: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:14:46.474: INFO: Container node-exporter ready: true, restart count 0 Aug 28 00:14:46.474: INFO: kube-apiserver-master1 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.474: INFO: Container kube-apiserver ready: true, restart count 0 Aug 28 00:14:46.474: INFO: kube-controller-manager-master1 started at 2021-08-27 20:54:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.474: INFO: Container kube-controller-manager ready: true, restart count 3 Aug 28 00:14:46.474: INFO: kube-proxy-rb5p6 started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.474: INFO: Container kube-proxy ready: true, restart count 1 Aug 28 00:14:46.474: INFO: coredns-7677f9bb54-dwtp5 started at 2021-08-27 20:49:16 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.474: INFO: Container coredns ready: true, restart count 1 W0828 00:14:46.487645 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:14:46.513: INFO: Latency metrics for node master1 Aug 28 00:14:46.513: INFO: Logging node info for node master2 Aug 28 00:14:46.516: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 666e473f-d9e6-4c06-8b56-06474d788f70 75544 0 2021-08-27 20:46:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"42:86:ff:30:bd:4d"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-27 20:46:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-27 20:46:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-27 20:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:53 +0000 UTC,LastTransitionTime:2021-08-27 20:51:53 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:44 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:44 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:44 +0000 UTC,LastTransitionTime:2021-08-27 20:46:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:14:44 +0000 UTC,LastTransitionTime:2021-08-27 20:48:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2835065974a64998811b9acd85de209b,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:309b9155-1e2a-4ebd-900f-bba5abfc3a5d,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:14:46.516: INFO: Logging kubelet events for node master2 Aug 28 00:14:46.518: INFO: Logging pods the kubelet thinks is on node master2 Aug 28 00:14:46.526: INFO: kube-apiserver-master2 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.526: INFO: Container kube-apiserver ready: true, restart count 0 Aug 28 00:14:46.526: INFO: kube-scheduler-master2 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.526: INFO: Container kube-scheduler ready: true, restart count 2 Aug 28 00:14:46.526: INFO: kube-proxy-b4mn9 started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.526: INFO: Container kube-proxy ready: true, restart count 1 Aug 28 00:14:46.526: INFO: node-feature-discovery-controller-5bf5c49849-zr9zd started at 2021-08-27 20:55:09 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.526: INFO: Container nfd-controller ready: true, restart count 0 Aug 28 00:14:46.526: INFO: kube-controller-manager-master2 started at 2021-08-27 20:51:01 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.526: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 28 00:14:46.526: INFO: kube-flannel-4znnq started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:14:46.526: INFO: Init container install-cni ready: true, restart count 2 Aug 28 00:14:46.526: INFO: Container kube-flannel ready: true, restart count 2 Aug 28 00:14:46.526: INFO: kube-multus-ds-amd64-4mgbk started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.526: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:14:46.526: INFO: prometheus-operator-5bb8cb9d8f-whr5p started at 2021-08-27 20:59:06 +0000 UTC (0+2 container statuses recorded) Aug 28 00:14:46.526: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:14:46.527: INFO: Container prometheus-operator ready: true, restart count 0 Aug 28 00:14:46.527: INFO: node-exporter-96jk5 started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:14:46.527: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:14:46.527: INFO: Container node-exporter ready: true, restart count 0 W0828 00:14:46.538040 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:14:46.562: INFO: Latency metrics for node master2 Aug 28 00:14:46.562: INFO: Logging node info for node master3 Aug 28 00:14:46.564: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 620b6dba-f2c5-46e9-b2ff-d2f4197167d0 75537 0 2021-08-27 20:47:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ce:de:ea:c3:40:4f"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-27 20:47:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-27 20:47:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-27 20:48:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:44 +0000 UTC,LastTransitionTime:2021-08-27 20:51:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:42 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:42 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:42 +0000 UTC,LastTransitionTime:2021-08-27 20:47:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:14:42 +0000 UTC,LastTransitionTime:2021-08-27 20:48:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:37decbffe0e84048b5801289ad3be5bf,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:c96fe8b9-1ce0-44cd-935a-b58987e26570,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496891,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:14:46.565: INFO: Logging kubelet events for node master3 Aug 28 00:14:46.567: INFO: Logging pods the kubelet thinks is on node master3 Aug 28 00:14:46.576: INFO: kube-controller-manager-master3 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.576: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 28 00:14:46.576: INFO: kube-proxy-8sxhm started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.576: INFO: Container kube-proxy ready: true, restart count 1 Aug 28 00:14:46.576: INFO: kube-flannel-fkz5d started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:14:46.576: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:14:46.576: INFO: Container kube-flannel ready: true, restart count 1 Aug 28 00:14:46.576: INFO: dns-autoscaler-5b7b5c9b6f-54xch started at 2021-08-27 20:49:19 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.576: INFO: Container autoscaler ready: true, restart count 1 Aug 28 00:14:46.576: INFO: coredns-7677f9bb54-rxplt started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.576: INFO: Container coredns ready: true, restart count 1 Aug 28 00:14:46.576: INFO: kube-apiserver-master3 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.576: INFO: Container kube-apiserver ready: true, restart count 0 Aug 28 00:14:46.576: INFO: kube-scheduler-master3 started at 2021-08-27 20:47:27 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.576: INFO: Container kube-scheduler ready: true, restart count 2 Aug 28 00:14:46.576: INFO: kube-multus-ds-amd64-wwcgv started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.576: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:14:46.576: INFO: node-exporter-d4m7q started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:14:46.576: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:14:46.576: INFO: Container node-exporter ready: true, restart count 0 W0828 00:14:46.588242 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:14:46.616: INFO: Latency metrics for node master3 Aug 28 00:14:46.616: INFO: Logging node info for node node1 Aug 28 00:14:46.620: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 e7a2481e-32db-4c83-bd9f-4a0687258e7a 75531 0 2021-08-27 20:48:09 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"56:c7:37:40:51:ca"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-27 20:48:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-27 20:48:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-27 20:57:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-27 20:57:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:51:49 +0000 UTC,LastTransitionTime:2021-08-27 20:51:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:41 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:41 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:41 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:14:41 +0000 UTC,LastTransitionTime:2021-08-27 20:48:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c1e38e80ea114a5f96601202301ce842,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:e769e86d-15c0-442c-a93b-bcc6c33ff1cd,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:331c6faa8b0d5ec72cf105e87d35df0a2f2baeec3d6217a51faa73f9460f937f localhost:30500/barometer-collectd:stable],SizeBytes:1238704157,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1003787960,},ContainerImage{Names:[localhost:30500/cmk@sha256:fd1487b0c07556a087eff669e70c501a704720dcd53ff75183593de6720585f2 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:d7300ccf7ff3e9cea2111d275143b8050618bbc1d1ffe41f46286b1696261243 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44393508,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:14:46.620: INFO: Logging kubelet events for node node1 Aug 28 00:14:46.623: INFO: Logging pods the kubelet thinks is on node node1 Aug 28 00:14:46.637: INFO: webserver-deployment-dd94f59b7-56q7x started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.637: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.637: INFO: webserver-deployment-dd94f59b7-f4kxs started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.637: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.637: INFO: nginx-proxy-node1 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.637: INFO: Container nginx-proxy ready: true, restart count 2 Aug 28 00:14:46.638: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-9lndx started at 2021-08-27 20:55:51 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 28 00:14:46.638: INFO: node-exporter-4cvlq started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:14:46.638: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:14:46.638: INFO: Container node-exporter ready: true, restart count 0 Aug 28 00:14:46.638: INFO: var-expansion-c588bc90-2b5d-4887-b768-04f3a7490adc started at 2021-08-28 00:11:25 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container dapi-container ready: false, restart count 0 Aug 28 00:14:46.638: INFO: webserver-deployment-dd94f59b7-bv7w9 started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.638: INFO: kubernetes-dashboard-86c6f9df5b-c56fg started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container kubernetes-dashboard ready: true, restart count 1 Aug 28 00:14:46.638: INFO: node-feature-discovery-worker-bd9kg started at 2021-08-27 20:55:06 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container nfd-worker ready: true, restart count 0 Aug 28 00:14:46.638: INFO: kube-proxy-pb5bl started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container kube-proxy ready: true, restart count 2 Aug 28 00:14:46.638: INFO: collectd-ccvwg started at 2021-08-27 21:04:15 +0000 UTC (0+3 container statuses recorded) Aug 28 00:14:46.638: INFO: Container collectd ready: true, restart count 0 Aug 28 00:14:46.638: INFO: Container collectd-exporter ready: true, restart count 0 Aug 28 00:14:46.638: INFO: Container rbac-proxy ready: true, restart count 0 Aug 28 00:14:46.638: INFO: webserver-deployment-dd94f59b7-wnjgv started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.638: INFO: prometheus-k8s-0 started at 2021-08-27 20:59:29 +0000 UTC (0+5 container statuses recorded) Aug 28 00:14:46.638: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 28 00:14:46.638: INFO: Container grafana ready: true, restart count 0 Aug 28 00:14:46.638: INFO: Container prometheus ready: true, restart count 1 Aug 28 00:14:46.638: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 28 00:14:46.638: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 28 00:14:46.638: INFO: adopt-release-s6jg4 started at 2021-08-28 00:07:35 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container c ready: false, restart count 0 Aug 28 00:14:46.638: INFO: kube-flannel-ssxn7 started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:14:46.638: INFO: Container kube-flannel ready: true, restart count 1 Aug 28 00:14:46.638: INFO: e2e-test-httpd-pod started at 2021-08-28 00:13:14 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container e2e-test-httpd-pod ready: false, restart count 0 Aug 28 00:14:46.638: INFO: cmk-init-discover-node1-spg26 started at 2021-08-27 20:57:37 +0000 UTC (0+3 container statuses recorded) Aug 28 00:14:46.638: INFO: Container discover ready: false, restart count 0 Aug 28 00:14:46.638: INFO: Container init ready: false, restart count 0 Aug 28 00:14:46.638: INFO: Container install ready: false, restart count 0 Aug 28 00:14:46.638: INFO: cmk-jw4m6 started at 2021-08-27 20:58:19 +0000 UTC (0+2 container statuses recorded) Aug 28 00:14:46.638: INFO: Container nodereport ready: true, restart count 0 Aug 28 00:14:46.638: INFO: Container reconcile ready: true, restart count 0 Aug 28 00:14:46.638: INFO: webserver-deployment-dd94f59b7-hddhg started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.638: INFO: kube-multus-ds-amd64-nn7bl started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:14:46.638: INFO: kubernetes-metrics-scraper-678c97765c-gtp5x started at 2021-08-27 20:49:21 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.638: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 W0828 00:14:46.651292 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:14:46.689: INFO: Latency metrics for node node1 Aug 28 00:14:46.689: INFO: Logging node info for node node2 Aug 28 00:14:46.692: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 eb7da7c0-513f-4072-a078-ad3d24f88114 75506 0 2021-08-27 20:48:09 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:88:9c:d1:39:68"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-27 20:48:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-27 20:48:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-27 20:48:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-27 20:55:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-27 20:58:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-27 20:58:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-27 20:50:36 +0000 UTC,LastTransitionTime:2021-08-27 20:50:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-28 00:14:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:09 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-28 00:14:37 +0000 UTC,LastTransitionTime:2021-08-27 20:48:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0ccfc2a4a9b7400c9ca53b5de0ca4970,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:26b02690-0814-4c92-9f6d-d315df796ce6,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:331c6faa8b0d5ec72cf105e87d35df0a2f2baeec3d6217a51faa73f9460f937f localhost:30500/barometer-collectd:stable],SizeBytes:1238704157,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[localhost:30500/cmk@sha256:fd1487b0c07556a087eff669e70c501a704720dcd53ff75183593de6720585f2 localhost:30500/cmk:v1.5.1],SizeBytes:723496952,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:d7300ccf7ff3e9cea2111d275143b8050618bbc1d1ffe41f46286b1696261243 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44393508,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:ae72171f047a37ee5423e0692df7429830919af16e9d668ab0c80b723863d102 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:cd98d1edca8e5e2e3ea42cbc463812483e5d069d10f0974ca9d484b5a7bd68db localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 28 00:14:46.692: INFO: Logging kubelet events for node node2 Aug 28 00:14:46.695: INFO: Logging pods the kubelet thinks is on node node2 Aug 28 00:14:46.707: INFO: test-cleanup-controller-gscmn started at 2021-08-28 00:13:33 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.707: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.707: INFO: cmk-webhook-6c9d5f8578-ndbx2 started at 2021-08-27 20:58:20 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.707: INFO: Container cmk-webhook ready: true, restart count 0 Aug 28 00:14:46.707: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-v99df started at 2021-08-27 21:02:08 +0000 UTC (0+2 container statuses recorded) Aug 28 00:14:46.707: INFO: Container tas-controller ready: true, restart count 0 Aug 28 00:14:46.707: INFO: Container tas-extender ready: true, restart count 0 Aug 28 00:14:46.707: INFO: downward-api-6ebc473f-df4d-4cc6-9ed0-d392e332a3ac started at 2021-08-28 00:12:14 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.707: INFO: Container dapi-container ready: false, restart count 0 Aug 28 00:14:46.707: INFO: kube-flannel-t9qv4 started at 2021-08-27 20:48:48 +0000 UTC (1+1 container statuses recorded) Aug 28 00:14:46.707: INFO: Init container install-cni ready: true, restart count 0 Aug 28 00:14:46.707: INFO: Container kube-flannel ready: true, restart count 2 Aug 28 00:14:46.707: INFO: cmk-init-discover-node2-l9qjd started at 2021-08-27 20:57:57 +0000 UTC (0+3 container statuses recorded) Aug 28 00:14:46.707: INFO: Container discover ready: false, restart count 0 Aug 28 00:14:46.707: INFO: Container init ready: false, restart count 0 Aug 28 00:14:46.707: INFO: Container install ready: false, restart count 0 Aug 28 00:14:46.707: INFO: node-feature-discovery-worker-54lfh started at 2021-08-27 20:55:06 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.707: INFO: Container nfd-worker ready: true, restart count 0 Aug 28 00:14:46.708: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4f962 started at 2021-08-27 20:55:51 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 28 00:14:46.708: INFO: webserver-deployment-dd94f59b7-4jn4k started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.708: INFO: nginx-proxy-node2 started at 2021-08-27 20:54:17 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container nginx-proxy ready: true, restart count 1 Aug 28 00:14:46.708: INFO: kube-proxy-r4q4t started at 2021-08-27 20:48:12 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container kube-proxy ready: true, restart count 2 Aug 28 00:14:46.708: INFO: kube-multus-ds-amd64-tfffk started at 2021-08-27 20:48:56 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container kube-multus ready: true, restart count 1 Aug 28 00:14:46.708: INFO: node-exporter-p6h5h started at 2021-08-27 20:59:13 +0000 UTC (0+2 container statuses recorded) Aug 28 00:14:46.708: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 28 00:14:46.708: INFO: Container node-exporter ready: true, restart count 0 Aug 28 00:14:46.708: INFO: webserver-deployment-dd94f59b7-rl54s started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.708: INFO: downward-api-c9653810-7bb3-4aad-bed1-588d15cecffc started at 2021-08-28 00:10:18 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container dapi-container ready: false, restart count 0 Aug 28 00:14:46.708: INFO: cmk-fzjgr started at 2021-08-27 20:58:20 +0000 UTC (0+2 container statuses recorded) Aug 28 00:14:46.708: INFO: Container nodereport ready: true, restart count 0 Aug 28 00:14:46.708: INFO: Container reconcile ready: true, restart count 0 Aug 28 00:14:46.708: INFO: webserver-deployment-dd94f59b7-77lh5 started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.708: INFO: adopt-release-thh76 started at 2021-08-28 00:07:35 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container c ready: false, restart count 0 Aug 28 00:14:46.708: INFO: webserver-deployment-dd94f59b7-2z9dr started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.708: INFO: webserver-deployment-dd94f59b7-ntnc5 started at 2021-08-28 00:09:42 +0000 UTC (0+1 container statuses recorded) Aug 28 00:14:46.708: INFO: Container httpd ready: false, restart count 0 Aug 28 00:14:46.708: INFO: collectd-64dp2 started at 2021-08-27 21:04:15 +0000 UTC (0+3 container statuses recorded) Aug 28 00:14:46.708: INFO: Container collectd ready: true, restart count 0 Aug 28 00:14:46.708: INFO: Container collectd-exporter ready: true, restart count 0 Aug 28 00:14:46.708: INFO: Container rbac-proxy ready: true, restart count 0 W0828 00:14:46.719574 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 28 00:14:46.760: INFO: Latency metrics for node node2 Aug 28 00:14:46.760: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-7164" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786