Running Suite: Kubernetes e2e suite =================================== Random Seed: 1621041157 - Will randomize all specs Will run 5484 specs Running in parallel across 10 nodes May 15 01:12:38.655: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.661: INFO: Waiting up to 30m0s for all (but 0) nodes to be schedulable May 15 01:12:38.684: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'kube-system' to be running and ready May 15 01:12:38.754: INFO: The status of Pod cmk-init-discover-node2-j75ff is Succeeded, skipping waiting May 15 01:12:38.754: INFO: 40 / 41 pods in namespace 'kube-system' are running and ready (0 seconds elapsed) May 15 01:12:38.754: INFO: expected 8 pod replicas in namespace 'kube-system', 8 are Running and Ready. May 15 01:12:38.754: INFO: Waiting up to 5m0s for all daemonsets in namespace 'kube-system' to start May 15 01:12:38.772: INFO: 2 / 2 pods ready in namespace 'kube-system' in daemonset 'cmk' (0 seconds elapsed) May 15 01:12:38.772: INFO: 5 / 5 pods ready in namespace 'kube-system' in daemonset 'kube-flannel' (0 seconds elapsed) May 15 01:12:38.772: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'kube-flannel-ds-arm' (0 seconds elapsed) May 15 01:12:38.772: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'kube-flannel-ds-arm64' (0 seconds elapsed) May 15 01:12:38.772: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'kube-flannel-ds-ppc64le' (0 seconds elapsed) May 15 01:12:38.772: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'kube-flannel-ds-s390x' (0 seconds elapsed) May 15 01:12:38.772: INFO: 5 / 5 pods ready in namespace 'kube-system' in daemonset 'kube-multus-ds-amd64' (0 seconds elapsed) May 15 01:12:38.772: INFO: 5 / 5 pods ready in namespace 'kube-system' in daemonset 'kube-proxy' (0 seconds elapsed) May 15 01:12:38.772: INFO: 2 / 2 pods ready in namespace 'kube-system' in daemonset 'node-feature-discovery-worker' (0 seconds elapsed) May 15 01:12:38.772: INFO: 2 / 2 pods ready in namespace 'kube-system' in daemonset 'sriov-net-dp-kube-sriov-device-plugin-amd64' (0 seconds elapsed) May 15 01:12:38.772: INFO: e2e test version: v1.19.10 May 15 01:12:38.773: INFO: kube-apiserver version: v1.19.8 May 15 01:12:38.773: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.779: INFO: Cluster IP family: ipv4 SSSSSSSS ------------------------------ May 15 01:12:38.774: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.795: INFO: Cluster IP family: ipv4 SSSSS ------------------------------ May 15 01:12:38.781: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.802: INFO: Cluster IP family: ipv4 SS ------------------------------ May 15 01:12:38.783: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.803: INFO: Cluster IP family: ipv4 SSS ------------------------------ May 15 01:12:38.784: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.805: INFO: Cluster IP family: ipv4 SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ May 15 01:12:38.795: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.815: INFO: Cluster IP family: ipv4 SSSSSSSSSSSSSSSSSSSSS ------------------------------ May 15 01:12:38.803: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.824: INFO: Cluster IP family: ipv4 SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ May 15 01:12:38.816: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.837: INFO: Cluster IP family: ipv4 SSSSSS ------------------------------ May 15 01:12:38.818: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.839: INFO: Cluster IP family: ipv4 SSSSS ------------------------------ May 15 01:12:38.821: INFO: >>> kubeConfig: /root/.kube/config May 15 01:12:38.842: INFO: Cluster IP family: ipv4 SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.093: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename node-problem-detector May 15 01:12:39.115: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 15 01:12:39.119: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:51 May 15 01:12:39.122: INFO: No SSH Key for provider skeleton: 'error reading SSH key /root/.ssh/id_rsa: 'open /root/.ssh/id_rsa: no such file or directory'' [AfterEach] [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 May 15 01:12:39.124: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "node-problem-detector-215" for this suite. S [SKIPPING] in Spec Setup (BeforeEach) [0.040 seconds] [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should run without error [BeforeEach] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:59 No SSH Key for provider skeleton: 'error reading SSH key /root/.ssh/id_rsa: 'open /root/.ssh/id_rsa: no such file or directory'' /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:52 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] AppArmor /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.692: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename apparmor May 15 01:12:39.713: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 15 01:12:39.715: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] load AppArmor profiles /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/apparmor.go:32 May 15 01:12:39.718: INFO: Only supported for node OS distro [gci ubuntu] (not debian) [AfterEach] load AppArmor profiles /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/apparmor.go:36 [AfterEach] [k8s.io] [sig-node] AppArmor /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 May 15 01:12:39.719: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "apparmor-9684" for this suite. S [SKIPPING] in Spec Setup (BeforeEach) [0.037 seconds] [k8s.io] [sig-node] AppArmor /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 load AppArmor profiles /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/apparmor.go:31 can disable an AppArmor profile, using unconfined [BeforeEach] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/apparmor.go:47 Only supported for node OS distro [gci ubuntu] (not debian) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/skipper/skipper.go:266 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.727: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap May 15 01:12:39.747: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 15 01:12:39.749: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should update ConfigMap successfully /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap.go:140 STEP: Creating ConfigMap configmap-152/configmap-test-97ebffc4-75e7-4e04-a3ab-e5a758f5f6c1 STEP: Updating configMap configmap-152/configmap-test-97ebffc4-75e7-4e04-a3ab-e5a758f5f6c1 STEP: Verifying update of ConfigMap configmap-152/configmap-test-97ebffc4-75e7-4e04-a3ab-e5a758f5f6c1 [AfterEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 May 15 01:12:39.759: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-152" for this suite. •SS ------------------------------ {"msg":"PASSED [sig-node] ConfigMap should update ConfigMap successfully","total":-1,"completed":1,"skipped":368,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.341: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubelet May 15 01:12:39.361: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 15 01:12:39.362: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] [sig-node] kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/kubelet.go:274 [BeforeEach] [k8s.io] [sig-node] Clean up pods on node /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/kubelet.go:295 [It] kubelet should be able to delete 10 pods per node in 1m0s. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/kubelet.go:341 STEP: Creating a RC of 20 pods and wait until all pods of this RC are running STEP: creating replication controller cleanup20-2ba2003f-6262-450a-a613-4c6fef7706cf in namespace kubelet-3013 I0515 01:12:39.399450 29 runners.go:190] Created replication controller with name: cleanup20-2ba2003f-6262-450a-a613-4c6fef7706cf, namespace: kubelet-3013, replica count: 20 I0515 01:12:49.449839 29 runners.go:190] cleanup20-2ba2003f-6262-450a-a613-4c6fef7706cf Pods: 20 out of 20 created, 0 running, 20 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0515 01:12:59.450187 29 runners.go:190] cleanup20-2ba2003f-6262-450a-a613-4c6fef7706cf Pods: 20 out of 20 created, 20 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady May 15 01:13:00.450: INFO: Checking pods on node node2 via /runningpods endpoint May 15 01:13:00.450: INFO: Checking pods on node node1 via /runningpods endpoint May 15 01:13:00.484: INFO: Resource usage on node "master1": container cpu(cores) memory_working_set(MB) memory_rss(MB) "/" 1.930 5382.92 1649.59 "runtime" 0.177 414.59 102.21 "kubelet" 0.177 414.59 102.21 Resource usage on node "master2": container cpu(cores) memory_working_set(MB) memory_rss(MB) "/" 3.539 4100.68 1866.08 "runtime" 0.152 349.30 96.23 "kubelet" 0.152 349.30 96.23 Resource usage on node "master3": container cpu(cores) memory_working_set(MB) memory_rss(MB) "/" 2.187 3707.10 1581.38 "runtime" 0.158 340.25 103.27 "kubelet" 0.158 340.25 103.27 Resource usage on node "node1": container cpu(cores) memory_working_set(MB) memory_rss(MB) "/" 1.990 6194.04 986.32 "runtime" 0.779 3293.01 108.11 "kubelet" 0.779 3293.01 108.11 Resource usage on node "node2": container cpu(cores) memory_working_set(MB) memory_rss(MB) "/" 2.388 3810.01 1084.05 "runtime" 0.891 943.67 103.97 "kubelet" 0.891 943.67 103.97 STEP: Deleting the RC STEP: deleting ReplicationController cleanup20-2ba2003f-6262-450a-a613-4c6fef7706cf in namespace kubelet-3013, will wait for the garbage collector to delete the pods May 15 01:13:00.541: INFO: Deleting ReplicationController cleanup20-2ba2003f-6262-450a-a613-4c6fef7706cf took: 5.087842ms May 15 01:13:01.742: INFO: Terminating ReplicationController cleanup20-2ba2003f-6262-450a-a613-4c6fef7706cf pods took: 1.200389372s May 15 01:13:13.343: INFO: Checking pods on node node2 via /runningpods endpoint May 15 01:13:13.343: INFO: Checking pods on node node1 via /runningpods endpoint May 15 01:13:13.358: INFO: Deleting 20 pods on 2 nodes completed in 1.015942767s after the RC was deleted May 15 01:13:13.359: INFO: CPU usage of containers on node "master1" :container 5th% 20th% 50th% 70th% 90th% 95th% 99th% "/" 0.000 0.000 0.549 1.930 1.930 1.930 1.930 "runtime" 0.000 0.000 0.118 0.118 0.118 0.118 0.118 "kubelet" 0.000 0.000 0.118 0.118 0.118 0.118 0.118 CPU usage of containers on node "master2" :container 5th% 20th% 50th% 70th% 90th% 95th% 99th% "/" 0.000 0.000 1.633 3.539 3.539 3.539 3.539 "runtime" 0.000 0.000 0.105 0.105 0.105 0.105 0.105 "kubelet" 0.000 0.000 0.105 0.105 0.105 0.105 0.105 CPU usage of containers on node "master3" :container 5th% 20th% 50th% 70th% 90th% 95th% 99th% "/" 0.000 0.000 1.592 2.187 2.187 2.187 2.187 "runtime" 0.000 0.000 0.158 0.158 0.158 0.158 0.158 "kubelet" 0.000 0.000 0.158 0.158 0.158 0.158 0.158 CPU usage of containers on node "node1" :container 5th% 20th% 50th% 70th% 90th% 95th% 99th% "/" 0.000 0.000 1.010 1.031 1.031 1.031 1.031 "runtime" 0.000 0.000 0.415 0.415 0.415 0.415 0.415 "kubelet" 0.000 0.000 0.415 0.415 0.415 0.415 0.415 CPU usage of containers on node "node2" :container 5th% 20th% 50th% 70th% 90th% 95th% 99th% "/" 0.000 0.000 1.136 1.796 1.796 1.796 1.796 "runtime" 0.000 0.000 0.456 0.456 0.456 0.456 0.456 "kubelet" 0.000 0.000 0.456 0.456 0.456 0.456 0.456 [AfterEach] [k8s.io] [sig-node] Clean up pods on node /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/kubelet.go:326 STEP: removing the label kubelet_cleanup off the node node1 STEP: verifying the node doesn't have the label kubelet_cleanup STEP: removing the label kubelet_cleanup off the node node2 STEP: verifying the node doesn't have the label kubelet_cleanup [AfterEach] [k8s.io] [sig-node] kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 May 15 01:13:13.385: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubelet-3013" for this suite. • [SLOW TEST:34.051 seconds] [k8s.io] [sig-node] kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 [k8s.io] [sig-node] Clean up pods on node /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 kubelet should be able to delete 10 pods per node in 1m0s. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/kubelet.go:341 ------------------------------ {"msg":"PASSED [k8s.io] [sig-node] kubelet [k8s.io] [sig-node] Clean up pods on node kubelet should be able to delete 10 pods per node in 1m0s.","total":-1,"completed":1,"skipped":187,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.123: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context May 15 01:12:39.142: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 15 01:12:39.144: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should support pod.Spec.SecurityContext.RunAsUser [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:77 STEP: Creating a pod to test pod.Spec.SecurityContext.RunAsUser May 15 01:12:39.161: INFO: Waiting up to 5m0s for pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700" in namespace "security-context-6277" to be "Succeeded or Failed" May 15 01:12:39.163: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1.895893ms May 15 01:12:41.166: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004681334s May 15 01:12:43.169: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007899837s May 15 01:12:45.173: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 6.011861113s May 15 01:12:47.180: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 8.018627373s May 15 01:12:49.184: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 10.022944893s May 15 01:12:51.188: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 12.026876329s May 15 01:12:53.191: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 14.029845845s May 15 01:12:55.194: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 16.032544956s May 15 01:12:57.197: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 18.036330882s May 15 01:12:59.201: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 20.039747436s May 15 01:13:01.205: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 22.043682045s May 15 01:13:03.207: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 24.046313458s May 15 01:13:05.210: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 26.049366974s May 15 01:13:07.213: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 28.052349029s May 15 01:13:09.216: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 30.054820425s May 15 01:13:11.220: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 32.058718507s May 15 01:13:13.223: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 34.062193599s May 15 01:13:15.228: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 36.067390412s May 15 01:13:17.231: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 38.069708529s May 15 01:13:19.235: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 40.074348208s May 15 01:13:21.239: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 42.078368282s May 15 01:13:23.243: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 44.082264019s May 15 01:13:25.247: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 46.085685815s May 15 01:13:27.250: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 48.089161581s May 15 01:13:29.253: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 50.091771554s May 15 01:13:31.256: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 52.095330587s May 15 01:13:33.259: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 54.098072821s May 15 01:13:35.264: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 56.102564154s May 15 01:13:37.267: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 58.106080842s May 15 01:13:39.271: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.109695282s May 15 01:13:41.275: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.113465771s May 15 01:13:43.278: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.11694475s May 15 01:13:45.282: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.121039859s May 15 01:13:47.285: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.123619454s May 15 01:13:49.288: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.126593092s May 15 01:13:51.291: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.129740123s May 15 01:13:53.294: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.132662382s May 15 01:13:55.297: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.135492907s May 15 01:13:57.299: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.13830155s May 15 01:13:59.304: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.142515091s May 15 01:14:01.307: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.145658186s May 15 01:14:03.310: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.14895738s May 15 01:14:05.313: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.151857241s May 15 01:14:07.316: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.15523302s May 15 01:14:09.320: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.158839059s May 15 01:14:11.323: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.161822812s May 15 01:14:13.326: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.164877916s May 15 01:14:15.331: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.170202523s May 15 01:14:17.335: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.1737779s May 15 01:14:19.338: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.176760987s May 15 01:14:21.341: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.179912315s May 15 01:14:23.347: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.186258236s May 15 01:14:25.351: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.189495614s May 15 01:14:27.353: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.192402703s May 15 01:14:29.357: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.195481013s May 15 01:14:31.360: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.199349612s May 15 01:14:33.364: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.202947373s May 15 01:14:35.367: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.20544746s May 15 01:14:37.369: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.208309703s May 15 01:14:39.373: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.212306443s May 15 01:14:41.376: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.215264772s May 15 01:14:43.379: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.218361543s May 15 01:14:45.384: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.223338697s May 15 01:14:47.388: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.226848128s May 15 01:14:49.392: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.231019524s May 15 01:14:51.396: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.234720514s May 15 01:14:53.400: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.238601491s May 15 01:14:55.404: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.242671098s May 15 01:14:57.406: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.245182646s May 15 01:14:59.409: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.248077713s May 15 01:15:01.412: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.251424046s May 15 01:15:03.417: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.25625055s May 15 01:15:05.420: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.259324644s May 15 01:15:07.424: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.262635854s May 15 01:15:09.427: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.266395779s May 15 01:15:11.431: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.270326093s May 15 01:15:13.435: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.273837521s May 15 01:15:15.439: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.27780141s May 15 01:15:17.442: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.280760123s May 15 01:15:19.445: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.283544335s May 15 01:15:21.447: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.286412974s May 15 01:15:23.452: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.290489873s May 15 01:15:25.455: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.293555031s May 15 01:15:27.458: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.297011555s May 15 01:15:29.461: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.300088336s May 15 01:15:31.464: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.302960396s May 15 01:15:33.468: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.30660247s May 15 01:15:35.470: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.30944557s May 15 01:15:37.474: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.312604153s May 15 01:15:39.476: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.315387613s May 15 01:15:41.480: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.318511857s May 15 01:15:43.484: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.323257537s May 15 01:15:45.488: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.326729675s May 15 01:15:47.490: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.329247469s May 15 01:15:49.494: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.332740289s May 15 01:15:51.497: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.335750207s May 15 01:15:53.500: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.339264791s May 15 01:15:55.504: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.343302101s May 15 01:15:57.508: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.346447949s May 15 01:15:59.511: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.350204019s May 15 01:16:01.515: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.353659892s May 15 01:16:03.518: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.356513051s May 15 01:16:05.520: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.359053528s May 15 01:16:07.524: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.362788029s May 15 01:16:09.527: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.365778049s May 15 01:16:11.530: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.36891054s May 15 01:16:13.533: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.372081592s May 15 01:16:15.536: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.374577157s May 15 01:16:17.538: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.3773841s May 15 01:16:19.542: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.380739038s May 15 01:16:21.546: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.384524209s May 15 01:16:23.550: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.388815074s May 15 01:16:25.554: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.392835921s May 15 01:16:27.557: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.395750381s May 15 01:16:29.561: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.399530145s May 15 01:16:31.564: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.402783115s May 15 01:16:33.567: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.406361192s May 15 01:16:35.571: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.409960886s May 15 01:16:37.574: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.412881475s May 15 01:16:39.577: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.416156175s May 15 01:16:41.581: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.419711928s May 15 01:16:43.584: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.42340239s May 15 01:16:45.588: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.426605984s May 15 01:16:47.591: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.429939376s May 15 01:16:49.595: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.434352222s May 15 01:16:51.598: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.437144422s May 15 01:16:53.601: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.44008624s May 15 01:16:55.604: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.442693631s May 15 01:16:57.607: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.446410006s May 15 01:16:59.611: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.450410096s May 15 01:17:01.614: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.452915851s May 15 01:17:03.618: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.456488515s May 15 01:17:05.620: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.458827837s May 15 01:17:07.623: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.46171927s May 15 01:17:09.626: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.464935904s May 15 01:17:11.629: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.467668885s May 15 01:17:13.632: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.470825826s May 15 01:17:15.636: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.474836883s May 15 01:17:17.639: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.477866695s May 15 01:17:19.642: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.480606524s May 15 01:17:21.645: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.483903824s May 15 01:17:23.648: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.486635083s May 15 01:17:25.650: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.489170674s May 15 01:17:27.654: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.493256941s May 15 01:17:29.657: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.495654627s May 15 01:17:31.659: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.498351323s May 15 01:17:33.662: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.50139263s May 15 01:17:35.665: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.504137511s May 15 01:17:37.668: INFO: Pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.507302806s May 15 01:17:39.682: INFO: Failed to get logs from node "node2" pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700" container "test-container": the server rejected our request for an unknown reason (get pods security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700) STEP: delete the pod May 15 01:17:39.690: INFO: Waiting for pod security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700 to disappear May 15 01:17:39.693: INFO: Pod security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700 still exists May 15 01:17:41.694: INFO: Waiting for pod security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700 to disappear May 15 01:17:41.697: INFO: Pod security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700 still exists May 15 01:17:43.694: INFO: Waiting for pod security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700 to disappear May 15 01:17:43.696: INFO: Pod security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700 no longer exists May 15 01:17:43.697: FAIL: Unexpected error: <*errors.errorString | 0xc001263000>: { s: "expected pod \"security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700\" success: Gave up after waiting 5m0s for pod \"security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700\" to be \"Succeeded or Failed\"", } expected pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700" success: Gave up after waiting 5m0s for pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000671e40, 0x4c7f1fb, 0x22, 0xc000181800, 0x0, 0xc0005ad1b8, 0x2, 0x2, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/node.glob..func14.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:83 +0x29a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0020e3980) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0020e3980) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0020e3980, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-6277". STEP: Found 7 events. May 15 01:17:43.703: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700: { } Scheduled: Successfully assigned security-context-6277/security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700 to node2 May 15 01:17:43.703: INFO: At 2021-05-15 01:12:41 +0000 UTC - event for security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700: {multus } AddedInterface: Add eth0 [10.244.4.132/24] May 15 01:17:43.703: INFO: At 2021-05-15 01:12:41 +0000 UTC - event for security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:17:43.703: INFO: At 2021-05-15 01:12:43 +0000 UTC - event for security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:17:43.703: INFO: At 2021-05-15 01:12:43 +0000 UTC - event for security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700: {kubelet node2} Failed: Error: ErrImagePull May 15 01:17:43.703: INFO: At 2021-05-15 01:12:49 +0000 UTC - event for security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:17:43.703: INFO: At 2021-05-15 01:12:49 +0000 UTC - event for security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700: {kubelet node2} Failed: Error: ImagePullBackOff May 15 01:17:43.705: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:17:43.705: INFO: May 15 01:17:43.710: INFO: Logging node info for node master1 May 15 01:17:43.713: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 143754 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:43.714: INFO: Logging kubelet events for node master1 May 15 01:17:43.720: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:17:43.748: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.748: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:43.748: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.748: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:17:43.748: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.748: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:43.748: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.748: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:43.748: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.748: INFO: Container docker-registry ready: true, restart count 0 May 15 01:17:43.748: INFO: Container nginx ready: true, restart count 0 May 15 01:17:43.748: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.748: INFO: Container nfd-controller ready: true, restart count 0 May 15 01:17:43.748: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.748: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:43.748: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:43.748: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:43.748: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:43.748: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.748: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:43.748: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:43.748: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.748: INFO: Container kube-scheduler ready: true, restart count 0 W0515 01:17:43.760990 37 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:43.798: INFO: Latency metrics for node master1 May 15 01:17:43.798: INFO: Logging node info for node master2 May 15 01:17:43.800: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 143741 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:43.800: INFO: Logging kubelet events for node master2 May 15 01:17:43.806: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:17:43.821: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:43.821: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:43.821: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:43.821: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.821: INFO: Container autoscaler ready: true, restart count 2 May 15 01:17:43.821: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.821: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:43.821: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:43.821: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.821: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:43.821: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:17:43.821: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.821: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:43.821: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.821: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:43.821: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.821: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:17:43.821: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.821: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:43.821: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.821: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:43.821: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.821: INFO: Container coredns ready: true, restart count 0 W0515 01:17:43.836610 37 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:43.871: INFO: Latency metrics for node master2 May 15 01:17:43.871: INFO: Logging node info for node master3 May 15 01:17:43.874: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 143730 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:43.874: INFO: Logging kubelet events for node master3 May 15 01:17:43.879: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:17:43.893: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.893: INFO: Container kube-controller-manager ready: true, restart count 3 May 15 01:17:43.893: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.893: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:17:43.893: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.893: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:43.893: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.893: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:17:43.893: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:43.893: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:43.893: INFO: Container kube-flannel ready: true, restart count 2 May 15 01:17:43.893: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.893: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:43.893: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.893: INFO: Container coredns ready: true, restart count 0 May 15 01:17:43.893: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.893: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:43.893: INFO: Container node-exporter ready: true, restart count 0 W0515 01:17:43.905086 37 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:43.929: INFO: Latency metrics for node master3 May 15 01:17:43.929: INFO: Logging node info for node node1 May 15 01:17:43.931: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 143757 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:43.932: INFO: Logging kubelet events for node node1 May 15 01:17:43.936: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:17:43.949: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.949: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:43.949: INFO: downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.949: INFO: Container dapi-container ready: false, restart count 0 May 15 01:17:43.949: INFO: security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 started at 2021-05-15 01:13:13 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.949: INFO: Container test-container ready: false, restart count 0 May 15 01:17:43.949: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:43.949: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:43.949: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:43.949: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.949: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:43.949: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:17:43.949: INFO: Container collectd ready: true, restart count 0 May 15 01:17:43.949: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:43.949: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:43.949: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.949: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:43.949: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:17:43.949: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:17:43.949: INFO: Container grafana ready: false, restart count 0 May 15 01:17:43.949: INFO: Container prometheus ready: false, restart count 22 May 15 01:17:43.949: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:17:43.949: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:17:43.949: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.949: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:43.949: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:43.949: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.949: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:43.949: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:43.949: INFO: security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.949: INFO: Container test-container ready: false, restart count 0 May 15 01:17:43.949: INFO: security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.949: INFO: Container test-container ready: false, restart count 0 May 15 01:17:43.949: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.949: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:43.949: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.949: INFO: Container kube-sriovdp ready: true, restart count 0 W0515 01:17:43.963655 37 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:44.005: INFO: Latency metrics for node node1 May 15 01:17:44.005: INFO: Logging node info for node node2 May 15 01:17:44.007: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 143740 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:44.008: INFO: Logging kubelet events for node node2 May 15 01:17:44.012: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:17:44.025: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.025: INFO: Container tas-controller ready: true, restart count 0 May 15 01:17:44.025: INFO: Container tas-extender ready: true, restart count 0 May 15 01:17:44.025: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:17:44.025: INFO: Container collectd ready: true, restart count 0 May 15 01:17:44.025: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:44.025: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:44.025: INFO: security-context-14b3d665-3495-4d96-b361-825cc9c9a896 started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.025: INFO: security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.025: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:44.025: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:44.025: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.025: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:44.025: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:44.025: INFO: security-context-45058297-c7f3-4916-9b49-578f0288c9ea started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.025: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container cmk-webhook ready: true, restart count 0 May 15 01:17:44.025: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:17:44.025: INFO: Container discover ready: false, restart count 0 May 15 01:17:44.025: INFO: Container init ready: false, restart count 0 May 15 01:17:44.025: INFO: Container install ready: false, restart count 0 May 15 01:17:44.025: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:44.025: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:44.025: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:17:44.025: INFO: security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.025: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.025: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:44.025: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:44.025: INFO: Init container install-cni ready: true, restart count 1 May 15 01:17:44.025: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:17:44.025: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.025: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:44.025: INFO: Container node-exporter ready: true, restart count 0 W0515 01:17:44.035767 37 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:44.080: INFO: Latency metrics for node node2 May 15 01:17:44.080: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-6277" for this suite. • Failure [304.969 seconds] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support pod.Spec.SecurityContext.RunAsUser [LinuxOnly] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:77 May 15 01:17:43.697: Unexpected error: <*errors.errorString | 0xc001263000>: { s: "expected pod \"security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700\" success: Gave up after waiting 5m0s for pod \"security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700\" to be \"Succeeded or Failed\"", } expected pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700" success: Gave up after waiting 5m0s for pod "security-context-e872fb69-aac7-4006-98b3-1b95ea5f4700" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] Security Context should support pod.Spec.SecurityContext.RunAsUser [LinuxOnly]","total":-1,"completed":0,"skipped":94,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support pod.Spec.SecurityContext.RunAsUser [LinuxOnly]"]} SSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.143: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context STEP: Waiting for a default service account to be provisioned in namespace [It] should support seccomp alpha runtime/default annotation [Feature:Seccomp] [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:166 STEP: Creating a pod to test seccomp.security.alpha.kubernetes.io/pod May 15 01:12:39.177: INFO: Waiting up to 5m0s for pod "security-context-38237b21-1156-486d-8a94-ac7667c80841" in namespace "security-context-5628" to be "Succeeded or Failed" May 15 01:12:39.178: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1.593842ms May 15 01:12:41.181: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004822924s May 15 01:12:43.186: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009740965s May 15 01:12:45.189: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 6.012801279s May 15 01:12:47.192: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015662238s May 15 01:12:49.195: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 10.018554155s May 15 01:12:51.199: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 12.022281659s May 15 01:12:53.202: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 14.02511696s May 15 01:12:55.204: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 16.027601592s May 15 01:12:57.207: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 18.02996952s May 15 01:12:59.209: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 20.032902389s May 15 01:13:01.212: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 22.035294261s May 15 01:13:03.215: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 24.038083206s May 15 01:13:05.218: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 26.041498149s May 15 01:13:07.221: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 28.044628735s May 15 01:13:09.224: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 30.047213404s May 15 01:13:11.227: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 32.050114717s May 15 01:13:13.231: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 34.054383477s May 15 01:13:15.234: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 36.057876952s May 15 01:13:17.238: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 38.061142476s May 15 01:13:19.241: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 40.064048943s May 15 01:13:21.243: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 42.066588359s May 15 01:13:23.246: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 44.069752251s May 15 01:13:25.249: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 46.072639978s May 15 01:13:27.252: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 48.074951024s May 15 01:13:29.255: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 50.078673522s May 15 01:13:31.259: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 52.082360283s May 15 01:13:33.262: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 54.085247185s May 15 01:13:35.266: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 56.089692123s May 15 01:13:37.270: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 58.093030879s May 15 01:13:39.273: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.09689127s May 15 01:13:41.276: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.099700078s May 15 01:13:43.280: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.103513262s May 15 01:13:45.283: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.106362442s May 15 01:13:47.285: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.108682572s May 15 01:13:49.288: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.111182173s May 15 01:13:51.292: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.115033382s May 15 01:13:53.294: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.117540242s May 15 01:13:55.299: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.122085851s May 15 01:13:57.301: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.124735246s May 15 01:13:59.306: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.129147994s May 15 01:14:01.309: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.13254174s May 15 01:14:03.314: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.13755689s May 15 01:14:05.317: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.14009866s May 15 01:14:07.320: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.142984763s May 15 01:14:09.323: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.146643823s May 15 01:14:11.327: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.150079683s May 15 01:14:13.330: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.15303693s May 15 01:14:15.333: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.156909825s May 15 01:14:17.337: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.160228615s May 15 01:14:19.341: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.164026418s May 15 01:14:21.345: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.168102288s May 15 01:14:23.348: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.17126953s May 15 01:14:25.351: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.174348698s May 15 01:14:27.353: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.176779452s May 15 01:14:29.357: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.180261469s May 15 01:14:31.361: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.184722971s May 15 01:14:33.364: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.187484512s May 15 01:14:35.370: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.192926569s May 15 01:14:37.373: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.196366876s May 15 01:14:39.377: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.200443626s May 15 01:14:41.380: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.20351439s May 15 01:14:43.383: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.206285673s May 15 01:14:45.386: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.20937495s May 15 01:14:47.388: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.211746031s May 15 01:14:49.392: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.215126392s May 15 01:14:51.396: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.219371866s May 15 01:14:53.399: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.222885347s May 15 01:14:55.403: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.226860913s May 15 01:14:57.406: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.229886155s May 15 01:14:59.409: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.2324104s May 15 01:15:01.412: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.235660603s May 15 01:15:03.417: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.240256375s May 15 01:15:05.420: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.243197193s May 15 01:15:07.424: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.24710088s May 15 01:15:09.427: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.250844724s May 15 01:15:11.431: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.254843272s May 15 01:15:13.435: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.258782523s May 15 01:15:15.439: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.26219756s May 15 01:15:17.442: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.265206463s May 15 01:15:19.445: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.268542109s May 15 01:15:21.448: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.271712224s May 15 01:15:23.452: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.274950988s May 15 01:15:25.455: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.278302617s May 15 01:15:27.458: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.28134179s May 15 01:15:29.461: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.284516252s May 15 01:15:31.464: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.287818257s May 15 01:15:33.468: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.291184109s May 15 01:15:35.470: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.29387285s May 15 01:15:37.473: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.296906784s May 15 01:15:39.476: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.299784822s May 15 01:15:41.480: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.303272863s May 15 01:15:43.484: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.307118458s May 15 01:15:45.488: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.311290313s May 15 01:15:47.490: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.313782208s May 15 01:15:49.493: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.31677414s May 15 01:15:51.496: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.31984259s May 15 01:15:53.499: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.32268823s May 15 01:15:55.503: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.326124717s May 15 01:15:57.506: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.329032415s May 15 01:15:59.509: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.332126636s May 15 01:16:01.513: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.336281909s May 15 01:16:03.517: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.339990505s May 15 01:16:05.520: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.343024941s May 15 01:16:07.524: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.347009119s May 15 01:16:09.527: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.350311078s May 15 01:16:11.530: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.353320761s May 15 01:16:13.532: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.355728437s May 15 01:16:15.536: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.359231117s May 15 01:16:17.538: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.361784253s May 15 01:16:19.542: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.365393304s May 15 01:16:21.546: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.368955226s May 15 01:16:23.551: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.374499282s May 15 01:16:25.555: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.377987375s May 15 01:16:27.557: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.38059527s May 15 01:16:29.561: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.384289222s May 15 01:16:31.565: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.388430954s May 15 01:16:33.568: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.391056537s May 15 01:16:35.573: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.39609263s May 15 01:16:37.576: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.399679084s May 15 01:16:39.579: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.40239049s May 15 01:16:41.581: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.404653423s May 15 01:16:43.585: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.408475629s May 15 01:16:45.588: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.411178906s May 15 01:16:47.591: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.414486264s May 15 01:16:49.596: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.419323807s May 15 01:16:51.599: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.422480476s May 15 01:16:53.602: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.42532873s May 15 01:16:55.611: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.434026926s May 15 01:16:57.613: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.436684511s May 15 01:16:59.619: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.442084618s May 15 01:17:01.623: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.446440618s May 15 01:17:03.626: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.448957276s May 15 01:17:05.629: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.452110278s May 15 01:17:07.632: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.455792613s May 15 01:17:09.636: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.459185894s May 15 01:17:11.640: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.46296769s May 15 01:17:13.644: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.467184693s May 15 01:17:15.651: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.474276813s May 15 01:17:17.654: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.477676896s May 15 01:17:19.658: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.481425832s May 15 01:17:21.662: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.485334692s May 15 01:17:23.665: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.488481895s May 15 01:17:25.669: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.492433182s May 15 01:17:27.672: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.495917869s May 15 01:17:29.676: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.499051678s May 15 01:17:31.680: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.503768324s May 15 01:17:33.683: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.506886735s May 15 01:17:35.687: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.51073139s May 15 01:17:37.691: INFO: Pod "security-context-38237b21-1156-486d-8a94-ac7667c80841": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.514250815s May 15 01:17:39.707: INFO: Failed to get logs from node "node1" pod "security-context-38237b21-1156-486d-8a94-ac7667c80841" container "test-container": the server rejected our request for an unknown reason (get pods security-context-38237b21-1156-486d-8a94-ac7667c80841) STEP: delete the pod May 15 01:17:39.711: INFO: Waiting for pod security-context-38237b21-1156-486d-8a94-ac7667c80841 to disappear May 15 01:17:39.714: INFO: Pod security-context-38237b21-1156-486d-8a94-ac7667c80841 still exists May 15 01:17:41.714: INFO: Waiting for pod security-context-38237b21-1156-486d-8a94-ac7667c80841 to disappear May 15 01:17:41.717: INFO: Pod security-context-38237b21-1156-486d-8a94-ac7667c80841 still exists May 15 01:17:43.714: INFO: Waiting for pod security-context-38237b21-1156-486d-8a94-ac7667c80841 to disappear May 15 01:17:43.716: INFO: Pod security-context-38237b21-1156-486d-8a94-ac7667c80841 no longer exists May 15 01:17:43.717: FAIL: Unexpected error: <*errors.errorString | 0xc00244a8e0>: { s: "expected pod \"security-context-38237b21-1156-486d-8a94-ac7667c80841\" success: Gave up after waiting 5m0s for pod \"security-context-38237b21-1156-486d-8a94-ac7667c80841\" to be \"Succeeded or Failed\"", } expected pod "security-context-38237b21-1156-486d-8a94-ac7667c80841" success: Gave up after waiting 5m0s for pod "security-context-38237b21-1156-486d-8a94-ac7667c80841" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000ec9ce0, 0x4ca47cd, 0x28, 0xc001901400, 0x0, 0xc00220b1c8, 0x1, 0x1, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/node.glob..func14.11() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:171 +0x195 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001a02a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001a02a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001a02a80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-5628". STEP: Found 8 events. May 15 01:17:43.721: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for security-context-38237b21-1156-486d-8a94-ac7667c80841: { } Scheduled: Successfully assigned security-context-5628/security-context-38237b21-1156-486d-8a94-ac7667c80841 to node1 May 15 01:17:43.721: INFO: At 2021-05-15 01:12:41 +0000 UTC - event for security-context-38237b21-1156-486d-8a94-ac7667c80841: {multus } AddedInterface: Add eth0 [10.244.3.48/24] May 15 01:17:43.721: INFO: At 2021-05-15 01:12:41 +0000 UTC - event for security-context-38237b21-1156-486d-8a94-ac7667c80841: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:17:43.721: INFO: At 2021-05-15 01:12:42 +0000 UTC - event for security-context-38237b21-1156-486d-8a94-ac7667c80841: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:17:43.721: INFO: At 2021-05-15 01:12:42 +0000 UTC - event for security-context-38237b21-1156-486d-8a94-ac7667c80841: {kubelet node1} Failed: Error: ErrImagePull May 15 01:17:43.721: INFO: At 2021-05-15 01:12:51 +0000 UTC - event for security-context-38237b21-1156-486d-8a94-ac7667c80841: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:17:43.721: INFO: At 2021-05-15 01:12:51 +0000 UTC - event for security-context-38237b21-1156-486d-8a94-ac7667c80841: {kubelet node1} Failed: Error: ImagePullBackOff May 15 01:17:43.721: INFO: At 2021-05-15 01:13:05 +0000 UTC - event for security-context-38237b21-1156-486d-8a94-ac7667c80841: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:17:43.723: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:17:43.723: INFO: May 15 01:17:43.729: INFO: Logging node info for node master1 May 15 01:17:43.731: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 143754 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:43.732: INFO: Logging kubelet events for node master1 May 15 01:17:43.738: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:17:43.759: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.759: INFO: Container docker-registry ready: true, restart count 0 May 15 01:17:43.759: INFO: Container nginx ready: true, restart count 0 May 15 01:17:43.759: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.759: INFO: Container nfd-controller ready: true, restart count 0 May 15 01:17:43.759: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.759: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:43.759: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.759: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:17:43.759: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.759: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:43.759: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.759: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:43.759: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.759: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:43.759: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:43.759: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:43.759: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:43.759: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.759: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:43.759: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:43.759: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.759: INFO: Container kube-scheduler ready: true, restart count 0 W0515 01:17:43.774632 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:43.800: INFO: Latency metrics for node master1 May 15 01:17:43.800: INFO: Logging node info for node master2 May 15 01:17:43.803: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 143741 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:43.803: INFO: Logging kubelet events for node master2 May 15 01:17:43.807: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:17:43.822: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.822: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:43.822: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.822: INFO: Container coredns ready: true, restart count 0 May 15 01:17:43.822: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.822: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:43.822: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.823: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:43.823: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.823: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:17:43.823: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:43.823: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:43.823: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:43.823: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.823: INFO: Container autoscaler ready: true, restart count 2 May 15 01:17:43.823: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.823: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:43.823: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:43.823: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.823: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:43.823: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:17:43.823: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.823: INFO: Container kube-apiserver ready: true, restart count 0 W0515 01:17:43.837887 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:43.869: INFO: Latency metrics for node master2 May 15 01:17:43.869: INFO: Logging node info for node master3 May 15 01:17:43.872: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 143730 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:43.872: INFO: Logging kubelet events for node master3 May 15 01:17:43.878: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:17:43.896: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.896: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:43.896: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.896: INFO: Container coredns ready: true, restart count 0 May 15 01:17:43.896: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.896: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:43.896: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:43.896: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.896: INFO: Container kube-controller-manager ready: true, restart count 3 May 15 01:17:43.896: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.896: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:17:43.896: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.896: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:43.896: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.896: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:17:43.896: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:43.896: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:43.896: INFO: Container kube-flannel ready: true, restart count 2 W0515 01:17:43.909492 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:43.935: INFO: Latency metrics for node master3 May 15 01:17:43.935: INFO: Logging node info for node node1 May 15 01:17:43.939: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 143757 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:43.940: INFO: Logging kubelet events for node node1 May 15 01:17:43.945: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:17:43.957: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.957: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:43.957: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:43.957: INFO: security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.957: INFO: Container test-container ready: false, restart count 0 May 15 01:17:43.957: INFO: security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.957: INFO: Container test-container ready: false, restart count 0 May 15 01:17:43.957: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.957: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:43.957: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.957: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:43.957: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.957: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:43.957: INFO: downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.957: INFO: Container dapi-container ready: false, restart count 0 May 15 01:17:43.957: INFO: security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 started at 2021-05-15 01:13:13 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.957: INFO: Container test-container ready: false, restart count 0 May 15 01:17:43.957: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:43.957: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:43.957: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:43.957: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.957: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:43.957: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:17:43.957: INFO: Container collectd ready: true, restart count 0 May 15 01:17:43.957: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:43.957: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:43.957: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:43.957: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:43.957: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:17:43.957: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:17:43.957: INFO: Container grafana ready: false, restart count 0 May 15 01:17:43.957: INFO: Container prometheus ready: false, restart count 22 May 15 01:17:43.957: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:17:43.957: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:17:43.957: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:17:43.957: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:43.957: INFO: Container node-exporter ready: true, restart count 0 W0515 01:17:43.970704 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:44.012: INFO: Latency metrics for node node1 May 15 01:17:44.012: INFO: Logging node info for node node2 May 15 01:17:44.014: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 143740 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:44.015: INFO: Logging kubelet events for node node2 May 15 01:17:44.020: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:17:44.032: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:17:44.032: INFO: Container discover ready: false, restart count 0 May 15 01:17:44.032: INFO: Container init ready: false, restart count 0 May 15 01:17:44.032: INFO: Container install ready: false, restart count 0 May 15 01:17:44.032: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:17:44.032: INFO: security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.032: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:44.032: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:44.032: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:44.032: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:44.032: INFO: Init container install-cni ready: true, restart count 1 May 15 01:17:44.032: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:17:44.032: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.032: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:44.032: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:44.032: INFO: security-context-14b3d665-3495-4d96-b361-825cc9c9a896 started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.032: INFO: security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.032: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.032: INFO: Container tas-controller ready: true, restart count 0 May 15 01:17:44.032: INFO: Container tas-extender ready: true, restart count 0 May 15 01:17:44.032: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:17:44.032: INFO: Container collectd ready: true, restart count 0 May 15 01:17:44.032: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:44.032: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:44.032: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:44.032: INFO: security-context-45058297-c7f3-4916-9b49-578f0288c9ea started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.032: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:44.032: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.032: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:44.032: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:44.032: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.032: INFO: Container cmk-webhook ready: true, restart count 0 W0515 01:17:44.045552 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:44.099: INFO: Latency metrics for node node2 May 15 01:17:44.099: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-5628" for this suite. • Failure [304.963 seconds] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support seccomp alpha runtime/default annotation [Feature:Seccomp] [LinuxOnly] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:166 May 15 01:17:43.717: Unexpected error: <*errors.errorString | 0xc00244a8e0>: { s: "expected pod \"security-context-38237b21-1156-486d-8a94-ac7667c80841\" success: Gave up after waiting 5m0s for pod \"security-context-38237b21-1156-486d-8a94-ac7667c80841\" to be \"Succeeded or Failed\"", } expected pod "security-context-38237b21-1156-486d-8a94-ac7667c80841" success: Gave up after waiting 5m0s for pod "security-context-38237b21-1156-486d-8a94-ac7667c80841" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ S ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] Security Context should support seccomp alpha runtime/default annotation [Feature:Seccomp] [LinuxOnly]","total":-1,"completed":0,"skipped":70,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support seccomp alpha runtime/default annotation [Feature:Seccomp] [LinuxOnly]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.483: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context May 15 01:12:39.506: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 15 01:12:39.508: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should support seccomp alpha unconfined annotation on the pod [Feature:Seccomp] [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:158 STEP: Creating a pod to test seccomp.security.alpha.kubernetes.io/pod May 15 01:12:39.524: INFO: Waiting up to 5m0s for pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896" in namespace "security-context-7691" to be "Succeeded or Failed" May 15 01:12:39.526: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1.925788ms May 15 01:12:41.530: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005485713s May 15 01:12:43.536: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4.011172338s May 15 01:12:45.539: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 6.014945658s May 15 01:12:47.542: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 8.01777115s May 15 01:12:49.545: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 10.020471849s May 15 01:12:51.549: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 12.024026801s May 15 01:12:53.553: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 14.028397691s May 15 01:12:55.557: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 16.032842383s May 15 01:12:57.560: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 18.035663017s May 15 01:12:59.565: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 20.040851508s May 15 01:13:01.568: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 22.043407923s May 15 01:13:03.572: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 24.046979577s May 15 01:13:05.575: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 26.050030972s May 15 01:13:07.578: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 28.05392708s May 15 01:13:09.582: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 30.056993218s May 15 01:13:11.585: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 32.06065369s May 15 01:13:13.589: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 34.064439751s May 15 01:13:15.593: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 36.068854792s May 15 01:13:17.597: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 38.072155049s May 15 01:13:19.599: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 40.074928942s May 15 01:13:21.603: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 42.078102012s May 15 01:13:23.606: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 44.08161009s May 15 01:13:25.610: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 46.085864593s May 15 01:13:27.613: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 48.08888536s May 15 01:13:29.616: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 50.091664869s May 15 01:13:31.620: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 52.095279254s May 15 01:13:33.624: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 54.099058907s May 15 01:13:35.627: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 56.102224967s May 15 01:13:37.630: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 58.105592057s May 15 01:13:39.633: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.108691146s May 15 01:13:41.636: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.111641911s May 15 01:13:43.639: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.11464222s May 15 01:13:45.642: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.117107822s May 15 01:13:47.644: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.119817475s May 15 01:13:49.648: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.123473392s May 15 01:13:51.652: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.12706968s May 15 01:13:53.655: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.13048355s May 15 01:13:55.658: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.13371891s May 15 01:13:57.662: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.137336329s May 15 01:13:59.664: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.139932687s May 15 01:14:01.669: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.144053254s May 15 01:14:03.673: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.148217219s May 15 01:14:05.675: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.15091347s May 15 01:14:07.680: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.155043201s May 15 01:14:09.682: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.157730141s May 15 01:14:11.685: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.160629799s May 15 01:14:13.689: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.164845754s May 15 01:14:15.694: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.169847375s May 15 01:14:17.697: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.172559542s May 15 01:14:19.702: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.177093372s May 15 01:14:21.706: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.181394818s May 15 01:14:23.710: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.185452742s May 15 01:14:25.713: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.188563716s May 15 01:14:27.716: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.191197278s May 15 01:14:29.719: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.194152851s May 15 01:14:31.723: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.198340063s May 15 01:14:33.726: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.201785332s May 15 01:14:35.729: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.204771428s May 15 01:14:37.732: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.20772124s May 15 01:14:39.736: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.211868175s May 15 01:14:41.740: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.215613441s May 15 01:14:43.744: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.219107195s May 15 01:14:45.747: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.222022782s May 15 01:14:47.751: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.226011637s May 15 01:14:49.754: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.229947435s May 15 01:14:51.761: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.236764001s May 15 01:14:53.764: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.239906188s May 15 01:14:55.773: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.248310615s May 15 01:14:57.777: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.252040251s May 15 01:14:59.780: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.255182863s May 15 01:15:01.783: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.258478056s May 15 01:15:03.786: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.261759459s May 15 01:15:05.790: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.26593142s May 15 01:15:07.794: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.269322727s May 15 01:15:09.798: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.27340836s May 15 01:15:11.801: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.276729967s May 15 01:15:13.804: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.279887594s May 15 01:15:15.807: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.282272538s May 15 01:15:17.810: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.285235014s May 15 01:15:19.813: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.288944105s May 15 01:15:21.816: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.291680794s May 15 01:15:23.819: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.294809208s May 15 01:15:25.823: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.297985614s May 15 01:15:27.827: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.302224767s May 15 01:15:29.830: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.30504237s May 15 01:15:31.834: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.309139184s May 15 01:15:33.837: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.312795963s May 15 01:15:35.842: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.317183181s May 15 01:15:37.845: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.320933268s May 15 01:15:39.848: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.323458887s May 15 01:15:41.852: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.327720959s May 15 01:15:43.855: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.330313872s May 15 01:15:45.859: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.334324634s May 15 01:15:47.862: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.337085061s May 15 01:15:49.865: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.340470866s May 15 01:15:51.868: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.343763009s May 15 01:15:53.871: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.346832548s May 15 01:15:55.876: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.351627243s May 15 01:15:57.880: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.355347586s May 15 01:15:59.884: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.359102615s May 15 01:16:01.888: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.363293823s May 15 01:16:03.891: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.366360483s May 15 01:16:05.896: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.371128052s May 15 01:16:07.901: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.376098494s May 15 01:16:09.904: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.379331071s May 15 01:16:11.909: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.384844066s May 15 01:16:13.913: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.387991125s May 15 01:16:15.916: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.391746094s May 15 01:16:17.921: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.396691052s May 15 01:16:19.926: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.40108239s May 15 01:16:21.930: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.405152388s May 15 01:16:23.933: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.408080636s May 15 01:16:25.936: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.411027717s May 15 01:16:27.939: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.414225018s May 15 01:16:29.943: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.418437478s May 15 01:16:31.948: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.423000787s May 15 01:16:33.951: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.426030893s May 15 01:16:35.955: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.430070425s May 15 01:16:37.958: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.433866244s May 15 01:16:39.962: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.437535508s May 15 01:16:41.965: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.440363628s May 15 01:16:43.969: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.444354113s May 15 01:16:45.971: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.446853221s May 15 01:16:47.975: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.450238502s May 15 01:16:49.979: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.454154496s May 15 01:16:51.982: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.457179677s May 15 01:16:53.985: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.460328156s May 15 01:16:55.988: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.46318744s May 15 01:16:57.991: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.466070996s May 15 01:16:59.994: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.469090431s May 15 01:17:01.997: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.472144711s May 15 01:17:04.001: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.476419235s May 15 01:17:06.005: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.48037504s May 15 01:17:08.008: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.483386231s May 15 01:17:10.011: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.486173538s May 15 01:17:12.013: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.488847615s May 15 01:17:14.017: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.492955599s May 15 01:17:16.021: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.496947726s May 15 01:17:18.026: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.501678488s May 15 01:17:20.032: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.50716871s May 15 01:17:22.035: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.510931488s May 15 01:17:24.039: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.514391412s May 15 01:17:26.042: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.517444814s May 15 01:17:28.045: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.520799598s May 15 01:17:30.049: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.524460578s May 15 01:17:32.052: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.527402064s May 15 01:17:34.055: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.530782452s May 15 01:17:36.059: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.534467659s May 15 01:17:38.063: INFO: Pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.538264821s May 15 01:17:40.072: INFO: Failed to get logs from node "node2" pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896" container "test-container": the server rejected our request for an unknown reason (get pods security-context-14b3d665-3495-4d96-b361-825cc9c9a896) STEP: delete the pod May 15 01:17:40.077: INFO: Waiting for pod security-context-14b3d665-3495-4d96-b361-825cc9c9a896 to disappear May 15 01:17:40.079: INFO: Pod security-context-14b3d665-3495-4d96-b361-825cc9c9a896 still exists May 15 01:17:42.081: INFO: Waiting for pod security-context-14b3d665-3495-4d96-b361-825cc9c9a896 to disappear May 15 01:17:42.085: INFO: Pod security-context-14b3d665-3495-4d96-b361-825cc9c9a896 still exists May 15 01:17:44.080: INFO: Waiting for pod security-context-14b3d665-3495-4d96-b361-825cc9c9a896 to disappear May 15 01:17:44.082: INFO: Pod security-context-14b3d665-3495-4d96-b361-825cc9c9a896 no longer exists May 15 01:17:44.083: FAIL: Unexpected error: <*errors.errorString | 0xc00462d020>: { s: "expected pod \"security-context-14b3d665-3495-4d96-b361-825cc9c9a896\" success: Gave up after waiting 5m0s for pod \"security-context-14b3d665-3495-4d96-b361-825cc9c9a896\" to be \"Succeeded or Failed\"", } expected pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896" success: Gave up after waiting 5m0s for pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc001e99600, 0x4ca47cd, 0x28, 0xc0038a6400, 0x0, 0xc0005671c8, 0x1, 0x1, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/node.glob..func14.10() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:163 +0x195 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001ed0d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001ed0d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001ed0d80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-7691". STEP: Found 9 events. May 15 01:17:44.088: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for security-context-14b3d665-3495-4d96-b361-825cc9c9a896: { } Scheduled: Successfully assigned security-context-7691/security-context-14b3d665-3495-4d96-b361-825cc9c9a896 to node2 May 15 01:17:44.088: INFO: At 2021-05-15 01:12:51 +0000 UTC - event for security-context-14b3d665-3495-4d96-b361-825cc9c9a896: {multus } AddedInterface: Add eth0 [10.244.4.144/24] May 15 01:17:44.088: INFO: At 2021-05-15 01:12:52 +0000 UTC - event for security-context-14b3d665-3495-4d96-b361-825cc9c9a896: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:17:44.088: INFO: At 2021-05-15 01:12:55 +0000 UTC - event for security-context-14b3d665-3495-4d96-b361-825cc9c9a896: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:17:44.088: INFO: At 2021-05-15 01:12:55 +0000 UTC - event for security-context-14b3d665-3495-4d96-b361-825cc9c9a896: {kubelet node2} Failed: Error: ErrImagePull May 15 01:17:44.088: INFO: At 2021-05-15 01:12:56 +0000 UTC - event for security-context-14b3d665-3495-4d96-b361-825cc9c9a896: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 15 01:17:44.088: INFO: At 2021-05-15 01:12:58 +0000 UTC - event for security-context-14b3d665-3495-4d96-b361-825cc9c9a896: {multus } AddedInterface: Add eth0 [10.244.4.148/24] May 15 01:17:44.088: INFO: At 2021-05-15 01:12:58 +0000 UTC - event for security-context-14b3d665-3495-4d96-b361-825cc9c9a896: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:17:44.088: INFO: At 2021-05-15 01:12:58 +0000 UTC - event for security-context-14b3d665-3495-4d96-b361-825cc9c9a896: {kubelet node2} Failed: Error: ImagePullBackOff May 15 01:17:44.090: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:17:44.090: INFO: May 15 01:17:44.094: INFO: Logging node info for node master1 May 15 01:17:44.096: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 143754 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:44.097: INFO: Logging kubelet events for node master1 May 15 01:17:44.103: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:17:44.122: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.122: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:44.122: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:44.122: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:44.122: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:44.122: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.122: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:44.122: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:44.122: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.122: INFO: Container kube-scheduler ready: true, restart count 0 May 15 01:17:44.122: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.122: INFO: Container nfd-controller ready: true, restart count 0 May 15 01:17:44.122: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.122: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:44.122: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.122: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:17:44.122: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.122: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:44.122: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.122: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:44.122: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.122: INFO: Container docker-registry ready: true, restart count 0 May 15 01:17:44.122: INFO: Container nginx ready: true, restart count 0 W0515 01:17:44.135114 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:44.161: INFO: Latency metrics for node master1 May 15 01:17:44.161: INFO: Logging node info for node master2 May 15 01:17:44.164: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 143741 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:44.164: INFO: Logging kubelet events for node master2 May 15 01:17:44.169: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:17:44.177: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.177: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:44.177: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:44.177: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.177: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:44.177: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:17:44.177: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.177: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:44.177: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.177: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:44.177: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.177: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:17:44.177: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:44.177: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:44.177: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:44.177: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.177: INFO: Container autoscaler ready: true, restart count 2 May 15 01:17:44.177: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.177: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:44.177: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.177: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:44.177: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.177: INFO: Container coredns ready: true, restart count 0 W0515 01:17:44.188652 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:44.212: INFO: Latency metrics for node master2 May 15 01:17:44.212: INFO: Logging node info for node master3 May 15 01:17:44.214: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 143730 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:44.215: INFO: Logging kubelet events for node master3 May 15 01:17:44.220: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:17:44.227: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.228: INFO: Container kube-controller-manager ready: true, restart count 3 May 15 01:17:44.228: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.228: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:17:44.228: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.228: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:44.228: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.228: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:17:44.228: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:44.228: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:44.228: INFO: Container kube-flannel ready: true, restart count 2 May 15 01:17:44.228: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.228: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:44.228: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.228: INFO: Container coredns ready: true, restart count 0 May 15 01:17:44.228: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.228: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:44.228: INFO: Container node-exporter ready: true, restart count 0 W0515 01:17:44.241125 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:44.264: INFO: Latency metrics for node master3 May 15 01:17:44.264: INFO: Logging node info for node node1 May 15 01:17:44.266: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 143757 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:44.267: INFO: Logging kubelet events for node node1 May 15 01:17:44.272: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:17:44.281: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.281: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:44.281: INFO: downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.281: INFO: Container dapi-container ready: false, restart count 0 May 15 01:17:44.281: INFO: security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 started at 2021-05-15 01:13:13 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.281: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.281: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:44.281: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:44.281: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:44.281: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.281: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:44.281: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:17:44.281: INFO: Container collectd ready: true, restart count 0 May 15 01:17:44.281: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:44.281: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:44.281: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.281: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:44.281: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:17:44.281: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:17:44.281: INFO: Container grafana ready: false, restart count 0 May 15 01:17:44.281: INFO: Container prometheus ready: false, restart count 22 May 15 01:17:44.281: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:17:44.281: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:17:44.281: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.281: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:44.281: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:44.281: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.281: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:44.281: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:44.281: INFO: security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.281: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.281: INFO: security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.281: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.281: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.281: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:44.281: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.281: INFO: Container kube-sriovdp ready: true, restart count 0 W0515 01:17:44.293747 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:44.325: INFO: Latency metrics for node node1 May 15 01:17:44.325: INFO: Logging node info for node node2 May 15 01:17:44.327: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 143740 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:44.328: INFO: Logging kubelet events for node node2 May 15 01:17:44.332: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:17:44.343: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:17:44.343: INFO: Container discover ready: false, restart count 0 May 15 01:17:44.343: INFO: Container init ready: false, restart count 0 May 15 01:17:44.343: INFO: Container install ready: false, restart count 0 May 15 01:17:44.343: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.343: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:44.343: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.343: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:44.343: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.343: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:17:44.343: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.343: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:44.343: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:44.343: INFO: Init container install-cni ready: true, restart count 1 May 15 01:17:44.343: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:17:44.343: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.343: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:44.343: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:44.343: INFO: security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.343: INFO: Container test-container ready: false, restart count 0 May 15 01:17:44.343: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.343: INFO: Container tas-controller ready: true, restart count 0 May 15 01:17:44.343: INFO: Container tas-extender ready: true, restart count 0 May 15 01:17:44.343: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:17:44.343: INFO: Container collectd ready: true, restart count 0 May 15 01:17:44.343: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:44.343: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:44.343: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.343: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:44.343: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.343: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:44.343: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:17:44.343: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:44.343: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:44.343: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:17:44.343: INFO: Container cmk-webhook ready: true, restart count 0 W0515 01:17:44.356735 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:44.394: INFO: Latency metrics for node node2 May 15 01:17:44.394: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-7691" for this suite. • Failure [304.923 seconds] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support seccomp alpha unconfined annotation on the pod [Feature:Seccomp] [LinuxOnly] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:158 May 15 01:17:44.083: Unexpected error: <*errors.errorString | 0xc00462d020>: { s: "expected pod \"security-context-14b3d665-3495-4d96-b361-825cc9c9a896\" success: Gave up after waiting 5m0s for pod \"security-context-14b3d665-3495-4d96-b361-825cc9c9a896\" to be \"Succeeded or Failed\"", } expected pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896" success: Gave up after waiting 5m0s for pod "security-context-14b3d665-3495-4d96-b361-825cc9c9a896" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ S ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] Security Context should support seccomp alpha unconfined annotation on the pod [Feature:Seccomp] [LinuxOnly]","total":-1,"completed":0,"skipped":237,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support seccomp alpha unconfined annotation on the pod [Feature:Seccomp] [LinuxOnly]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.264: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context May 15 01:12:39.288: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 15 01:12:39.291: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should support container.SecurityContext.RunAsUser And container.SecurityContext.RunAsGroup [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:118 STEP: Creating a pod to test pod.Spec.SecurityContext.RunAsUser May 15 01:12:39.309: INFO: Waiting up to 5m0s for pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7" in namespace "security-context-5943" to be "Succeeded or Failed" May 15 01:12:39.312: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.837074ms May 15 01:12:41.316: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007135001s May 15 01:12:43.322: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.012776622s May 15 01:12:45.328: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.019278777s May 15 01:12:47.331: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.022160735s May 15 01:12:49.335: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 10.025569511s May 15 01:12:51.339: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 12.030057357s May 15 01:12:53.343: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 14.033439481s May 15 01:12:55.348: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 16.038951201s May 15 01:12:57.351: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 18.041585196s May 15 01:12:59.355: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 20.045489925s May 15 01:13:01.359: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 22.049594964s May 15 01:13:03.363: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 24.054341464s May 15 01:13:05.367: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 26.058344305s May 15 01:13:07.370: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 28.061267605s May 15 01:13:09.373: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 30.06370038s May 15 01:13:11.377: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 32.068153031s May 15 01:13:13.380: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 34.070931896s May 15 01:13:15.384: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 36.075252961s May 15 01:13:17.387: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 38.07764043s May 15 01:13:19.390: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 40.080756444s May 15 01:13:21.394: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 42.084764988s May 15 01:13:23.398: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 44.089183971s May 15 01:13:25.402: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 46.093398348s May 15 01:13:27.406: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 48.096880266s May 15 01:13:29.410: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 50.100549944s May 15 01:13:31.413: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 52.104431721s May 15 01:13:33.417: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 54.107811031s May 15 01:13:35.424: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 56.114692005s May 15 01:13:37.427: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 58.11756458s May 15 01:13:39.430: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.120631729s May 15 01:13:41.435: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.12578953s May 15 01:13:43.440: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.130710117s May 15 01:13:45.444: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.135177973s May 15 01:13:47.449: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.139501085s May 15 01:13:49.452: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.142448221s May 15 01:13:51.457: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.148110965s May 15 01:13:53.461: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.151742593s May 15 01:13:55.467: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.158360814s May 15 01:13:57.470: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.161428536s May 15 01:13:59.476: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.166745519s May 15 01:14:01.481: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.171501272s May 15 01:14:03.485: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.175883542s May 15 01:14:05.489: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.180378461s May 15 01:14:07.492: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.183149243s May 15 01:14:09.495: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.186296222s May 15 01:14:11.500: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.19118085s May 15 01:14:13.504: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.194593004s May 15 01:14:15.507: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.198226702s May 15 01:14:17.511: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.202037621s May 15 01:14:19.514: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.205086341s May 15 01:14:21.518: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.20912452s May 15 01:14:23.522: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.213396243s May 15 01:14:25.528: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.218637475s May 15 01:14:27.532: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.2225893s May 15 01:14:29.536: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.226770754s May 15 01:14:31.541: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.232328309s May 15 01:14:33.546: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.23664326s May 15 01:14:35.551: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.241929521s May 15 01:14:37.554: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.244913051s May 15 01:14:39.557: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.248255051s May 15 01:14:41.563: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.2541157s May 15 01:14:43.566: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.256605628s May 15 01:14:45.568: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.259299583s May 15 01:14:47.572: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.26273739s May 15 01:14:49.574: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.26522016s May 15 01:14:51.578: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.269187248s May 15 01:14:53.581: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.272084846s May 15 01:14:55.585: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.276373189s May 15 01:14:57.589: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.279524643s May 15 01:14:59.592: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.282960379s May 15 01:15:01.596: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.286547415s May 15 01:15:03.599: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.290148211s May 15 01:15:05.602: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.293370896s May 15 01:15:07.605: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.295816141s May 15 01:15:09.608: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.298527206s May 15 01:15:11.611: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.302299471s May 15 01:15:13.614: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.305374262s May 15 01:15:15.619: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.31025319s May 15 01:15:17.622: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.313300551s May 15 01:15:19.626: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.317354594s May 15 01:15:21.630: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.320806848s May 15 01:15:23.634: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.325253234s May 15 01:15:25.638: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.328571396s May 15 01:15:27.641: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.332285315s May 15 01:15:29.644: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.335183649s May 15 01:15:31.649: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.339463741s May 15 01:15:33.652: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.342599071s May 15 01:15:35.656: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.346586007s May 15 01:15:37.658: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.349343657s May 15 01:15:39.663: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.3537263s May 15 01:15:41.666: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.356886356s May 15 01:15:43.670: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.360521558s May 15 01:15:45.672: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.363327123s May 15 01:15:47.676: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.367154846s May 15 01:15:49.679: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.370057095s May 15 01:15:51.687: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.377722299s May 15 01:15:53.691: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.381492784s May 15 01:15:55.697: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.38793963s May 15 01:15:57.701: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.391518036s May 15 01:15:59.704: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.395056323s May 15 01:16:01.707: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.398197294s May 15 01:16:03.710: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.401324988s May 15 01:16:05.714: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.405183432s May 15 01:16:07.718: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.409285534s May 15 01:16:09.722: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.412550926s May 15 01:16:11.726: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.417035577s May 15 01:16:13.729: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.419806733s May 15 01:16:15.732: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.42338534s May 15 01:16:17.737: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.427676871s May 15 01:16:19.740: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.431235472s May 15 01:16:21.744: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.435438037s May 15 01:16:23.748: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.438880153s May 15 01:16:25.752: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.442592785s May 15 01:16:27.755: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.445903473s May 15 01:16:29.758: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.449323655s May 15 01:16:31.762: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.452656788s May 15 01:16:33.765: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.45634936s May 15 01:16:35.769: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.459605839s May 15 01:16:37.772: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.463061856s May 15 01:16:39.776: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.466813487s May 15 01:16:41.780: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.470750479s May 15 01:16:43.783: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.47392937s May 15 01:16:45.787: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.477525098s May 15 01:16:47.790: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.481334144s May 15 01:16:49.793: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.484423172s May 15 01:16:51.800: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.490707815s May 15 01:16:53.803: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.494428727s May 15 01:16:55.811: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.501806383s May 15 01:16:57.815: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.506350865s May 15 01:16:59.821: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.511483774s May 15 01:17:01.824: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.514759517s May 15 01:17:03.827: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.517826283s May 15 01:17:05.830: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.521203982s May 15 01:17:07.833: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.524386307s May 15 01:17:09.837: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.527643273s May 15 01:17:11.842: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.53265558s May 15 01:17:13.844: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.535345279s May 15 01:17:15.850: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.540818416s May 15 01:17:17.854: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.545076925s May 15 01:17:19.859: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.549443178s May 15 01:17:21.863: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.553590257s May 15 01:17:23.865: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.55632378s May 15 01:17:25.871: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.56144517s May 15 01:17:27.874: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.565288704s May 15 01:17:29.878: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.569091884s May 15 01:17:31.884: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.574722342s May 15 01:17:33.887: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.578275351s May 15 01:17:35.890: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.580720865s May 15 01:17:37.892: INFO: Pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.583141444s May 15 01:17:39.899: INFO: Failed to get logs from node "node2" pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7" container "test-container": the server rejected our request for an unknown reason (get pods security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7) STEP: delete the pod May 15 01:17:39.903: INFO: Waiting for pod security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 to disappear May 15 01:17:39.905: INFO: Pod security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 still exists May 15 01:17:41.906: INFO: Waiting for pod security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 to disappear May 15 01:17:41.908: INFO: Pod security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 still exists May 15 01:17:43.906: INFO: Waiting for pod security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 to disappear May 15 01:17:43.908: INFO: Pod security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 still exists May 15 01:17:45.906: INFO: Waiting for pod security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 to disappear May 15 01:17:45.908: INFO: Pod security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 no longer exists May 15 01:17:45.909: FAIL: Unexpected error: <*errors.errorString | 0xc001e791d0>: { s: "expected pod \"security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7\" success: Gave up after waiting 5m0s for pod \"security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7\" to be \"Succeeded or Failed\"", } expected pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7" success: Gave up after waiting 5m0s for pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0005158c0, 0x4c7f1fb, 0x22, 0xc000780c00, 0x0, 0xc000b451b8, 0x2, 0x2, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/node.glob..func14.5() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:131 +0x3fb k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000477800) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc000477800) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc000477800, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-5943". STEP: Found 7 events. May 15 01:17:45.913: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7: { } Scheduled: Successfully assigned security-context-5943/security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7 to node2 May 15 01:17:45.913: INFO: At 2021-05-15 01:12:43 +0000 UTC - event for security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7: {multus } AddedInterface: Add eth0 [10.244.4.133/24] May 15 01:17:45.913: INFO: At 2021-05-15 01:12:43 +0000 UTC - event for security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:17:45.913: INFO: At 2021-05-15 01:12:44 +0000 UTC - event for security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:17:45.913: INFO: At 2021-05-15 01:12:44 +0000 UTC - event for security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7: {kubelet node2} Failed: Error: ErrImagePull May 15 01:17:45.913: INFO: At 2021-05-15 01:12:44 +0000 UTC - event for security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:17:45.913: INFO: At 2021-05-15 01:12:44 +0000 UTC - event for security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7: {kubelet node2} Failed: Error: ImagePullBackOff May 15 01:17:45.915: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:17:45.915: INFO: May 15 01:17:45.920: INFO: Logging node info for node master1 May 15 01:17:45.922: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 143754 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:45.923: INFO: Logging kubelet events for node master1 May 15 01:17:45.928: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:17:45.949: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.949: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:17:45.949: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.949: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:45.949: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.949: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:45.949: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:17:45.949: INFO: Container docker-registry ready: true, restart count 0 May 15 01:17:45.949: INFO: Container nginx ready: true, restart count 0 May 15 01:17:45.949: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.949: INFO: Container nfd-controller ready: true, restart count 0 May 15 01:17:45.949: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.949: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:45.949: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:45.949: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:45.949: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:45.949: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:45.949: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:45.949: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:45.949: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.949: INFO: Container kube-scheduler ready: true, restart count 0 May 15 01:17:45.949: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.949: INFO: Container kube-controller-manager ready: true, restart count 2 W0515 01:17:45.963621 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:45.990: INFO: Latency metrics for node master1 May 15 01:17:45.990: INFO: Logging node info for node master2 May 15 01:17:45.992: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 143741 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:45.993: INFO: Logging kubelet events for node master2 May 15 01:17:45.997: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:17:46.004: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.004: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:46.004: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:46.004: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.004: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:46.004: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:17:46.004: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.004: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:46.004: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.004: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:46.004: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.004: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:17:46.004: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:46.004: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:46.004: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:46.004: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.004: INFO: Container autoscaler ready: true, restart count 2 May 15 01:17:46.004: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.004: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:46.004: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.004: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:46.004: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.004: INFO: Container coredns ready: true, restart count 0 W0515 01:17:46.014322 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:46.039: INFO: Latency metrics for node master2 May 15 01:17:46.039: INFO: Logging node info for node master3 May 15 01:17:46.041: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 143730 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:46.041: INFO: Logging kubelet events for node master3 May 15 01:17:46.047: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:17:46.055: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.055: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:17:46.055: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.055: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:46.055: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.055: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:17:46.055: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:46.055: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:46.055: INFO: Container kube-flannel ready: true, restart count 2 May 15 01:17:46.055: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.055: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:46.055: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.055: INFO: Container coredns ready: true, restart count 0 May 15 01:17:46.055: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.055: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:46.055: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:46.055: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.055: INFO: Container kube-controller-manager ready: true, restart count 3 W0515 01:17:46.070137 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:46.095: INFO: Latency metrics for node master3 May 15 01:17:46.095: INFO: Logging node info for node node1 May 15 01:17:46.098: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 143757 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:46.099: INFO: Logging kubelet events for node node1 May 15 01:17:46.104: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:17:46.117: INFO: security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container test-container ready: false, restart count 0 May 15 01:17:46.117: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:46.117: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:46.117: INFO: pod-submit-status-2-0 started at 2021-05-15 01:17:45 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container busybox ready: false, restart count 0 May 15 01:17:46.117: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:46.117: INFO: downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container dapi-container ready: false, restart count 0 May 15 01:17:46.117: INFO: security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 started at 2021-05-15 01:13:13 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container test-container ready: false, restart count 0 May 15 01:17:46.117: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:17:46.117: INFO: Container collectd ready: true, restart count 0 May 15 01:17:46.117: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:46.117: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:46.117: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:46.117: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:46.117: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:46.117: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:46.117: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:46.117: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:17:46.117: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:17:46.117: INFO: Container grafana ready: false, restart count 0 May 15 01:17:46.117: INFO: Container prometheus ready: false, restart count 22 May 15 01:17:46.117: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:17:46.117: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:17:46.117: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.117: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:46.117: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:46.117: INFO: security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container test-container ready: false, restart count 0 May 15 01:17:46.117: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.118: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:46.118: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:46.118: INFO: pod-submit-status-0-0 started at 2021-05-15 01:17:45 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.118: INFO: Container busybox ready: false, restart count 0 W0515 01:17:46.132357 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:46.670: INFO: Latency metrics for node node1 May 15 01:17:46.670: INFO: Logging node info for node node2 May 15 01:17:46.672: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 143740 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:46.673: INFO: Logging kubelet events for node node2 May 15 01:17:46.678: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:17:46.691: INFO: security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container test-container ready: false, restart count 0 May 15 01:17:46.691: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.691: INFO: Container tas-controller ready: true, restart count 0 May 15 01:17:46.691: INFO: Container tas-extender ready: true, restart count 0 May 15 01:17:46.691: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:17:46.691: INFO: Container collectd ready: true, restart count 0 May 15 01:17:46.691: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:46.691: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:46.691: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:46.691: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:46.691: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.691: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:46.691: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:46.691: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container cmk-webhook ready: true, restart count 0 May 15 01:17:46.691: INFO: pod-submit-remove-84d378b0-3001-4971-b893-6beedd97e9fa started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container agnhost-container ready: false, restart count 0 May 15 01:17:46.691: INFO: pod-submit-status-1-0 started at 2021-05-15 01:17:45 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container busybox ready: false, restart count 0 May 15 01:17:46.691: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:17:46.691: INFO: Container discover ready: false, restart count 0 May 15 01:17:46.691: INFO: Container init ready: false, restart count 0 May 15 01:17:46.691: INFO: Container install ready: false, restart count 0 May 15 01:17:46.691: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:46.691: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:46.691: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:17:46.691: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:46.691: INFO: master started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.691: INFO: Container cntr ready: false, restart count 0 May 15 01:17:46.691: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:46.691: INFO: Init container install-cni ready: true, restart count 1 May 15 01:17:46.691: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:17:46.691: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.691: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:46.691: INFO: Container node-exporter ready: true, restart count 0 W0515 01:17:46.704153 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:46.844: INFO: Latency metrics for node node2 May 15 01:17:46.844: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-5943" for this suite. • Failure [307.590 seconds] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support container.SecurityContext.RunAsUser And container.SecurityContext.RunAsGroup [LinuxOnly] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:118 May 15 01:17:45.909: Unexpected error: <*errors.errorString | 0xc001e791d0>: { s: "expected pod \"security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7\" success: Gave up after waiting 5m0s for pod \"security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7\" to be \"Succeeded or Failed\"", } expected pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7" success: Gave up after waiting 5m0s for pod "security-context-9975d8f0-d1f9-42bf-a0ae-8c2cf17eabb7" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ [BeforeEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.362: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context May 15 01:12:39.382: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 15 01:12:39.383: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should support pod.Spec.SecurityContext.SupplementalGroups [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:69 STEP: Creating a pod to test pod.Spec.SecurityContext.SupplementalGroups May 15 01:12:39.402: INFO: Waiting up to 5m0s for pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea" in namespace "security-context-7554" to be "Succeeded or Failed" May 15 01:12:39.404: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2.180368ms May 15 01:12:41.406: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004539508s May 15 01:12:43.409: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007061879s May 15 01:12:45.412: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 6.009922027s May 15 01:12:47.414: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 8.012664434s May 15 01:12:49.417: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 10.015723517s May 15 01:12:51.421: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 12.019230678s May 15 01:12:53.423: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 14.021668169s May 15 01:12:55.427: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 16.025132103s May 15 01:12:57.430: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 18.02863087s May 15 01:12:59.433: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 20.031534536s May 15 01:13:01.437: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 22.03480107s May 15 01:13:03.440: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 24.038177748s May 15 01:13:05.444: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 26.041908071s May 15 01:13:07.447: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 28.045511218s May 15 01:13:09.451: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 30.048823029s May 15 01:13:11.454: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 32.051778358s May 15 01:13:13.457: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 34.055138008s May 15 01:13:15.461: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 36.059196772s May 15 01:13:17.464: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 38.061953521s May 15 01:13:19.467: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 40.06485439s May 15 01:13:21.469: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 42.067634517s May 15 01:13:23.473: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 44.071017517s May 15 01:13:25.476: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 46.07379291s May 15 01:13:27.478: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 48.076489457s May 15 01:13:29.482: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 50.080013327s May 15 01:13:31.485: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 52.083512266s May 15 01:13:33.489: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 54.087620683s May 15 01:13:35.493: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 56.090781558s May 15 01:13:37.496: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 58.094237549s May 15 01:13:39.500: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.09818623s May 15 01:13:41.504: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.102215736s May 15 01:13:43.507: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.10516225s May 15 01:13:45.510: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.108656518s May 15 01:13:47.513: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.111745805s May 15 01:13:49.516: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.114622856s May 15 01:13:51.519: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.117623634s May 15 01:13:53.523: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.121082681s May 15 01:13:55.528: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.125842363s May 15 01:13:57.531: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.129577723s May 15 01:13:59.535: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.132917048s May 15 01:14:01.538: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.13655852s May 15 01:14:03.543: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.141767202s May 15 01:14:05.546: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.144618613s May 15 01:14:07.549: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.147022623s May 15 01:14:09.552: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.149955674s May 15 01:14:11.555: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.152834718s May 15 01:14:13.557: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.155702546s May 15 01:14:15.561: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.158895267s May 15 01:14:17.564: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.162710409s May 15 01:14:19.567: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.165181962s May 15 01:14:21.570: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.168057012s May 15 01:14:23.573: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.171244321s May 15 01:14:25.576: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.174200535s May 15 01:14:27.579: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.177761306s May 15 01:14:29.582: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.180540625s May 15 01:14:31.585: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.183122824s May 15 01:14:33.587: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.185711187s May 15 01:14:35.591: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.189365979s May 15 01:14:37.596: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.193864547s May 15 01:14:39.600: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.198186112s May 15 01:14:41.603: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.200947127s May 15 01:14:43.605: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.203721616s May 15 01:14:45.608: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.206485904s May 15 01:14:47.611: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.209558526s May 15 01:14:49.614: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.212276616s May 15 01:14:51.617: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.215466635s May 15 01:14:53.620: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.218685426s May 15 01:14:55.623: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.221424024s May 15 01:14:57.626: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.224359792s May 15 01:14:59.629: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.227092816s May 15 01:15:01.631: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.229332484s May 15 01:15:03.634: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.232276596s May 15 01:15:05.637: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.235350943s May 15 01:15:07.640: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.23829057s May 15 01:15:09.644: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.24213486s May 15 01:15:11.647: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.244860187s May 15 01:15:13.649: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.247723265s May 15 01:15:15.653: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.250810294s May 15 01:15:17.655: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.253612378s May 15 01:15:19.658: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.256589446s May 15 01:15:21.661: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.259631622s May 15 01:15:23.664: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.262179487s May 15 01:15:25.666: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.264630598s May 15 01:15:27.669: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.266883146s May 15 01:15:29.671: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.269677898s May 15 01:15:31.674: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.272556206s May 15 01:15:33.677: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.275621948s May 15 01:15:35.680: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.278234287s May 15 01:15:37.683: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.281541384s May 15 01:15:39.687: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.285075379s May 15 01:15:41.691: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.289000996s May 15 01:15:43.694: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.291930262s May 15 01:15:45.697: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.29479824s May 15 01:15:47.699: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.297499617s May 15 01:15:49.702: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.300142498s May 15 01:15:51.706: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.304353763s May 15 01:15:53.709: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.307071241s May 15 01:15:55.714: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.31186028s May 15 01:15:57.717: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.315671777s May 15 01:15:59.721: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.318901085s May 15 01:16:01.724: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.322206577s May 15 01:16:03.727: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.324947404s May 15 01:16:05.730: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.327827703s May 15 01:16:07.733: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.331083297s May 15 01:16:09.735: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.333762764s May 15 01:16:11.738: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.336625152s May 15 01:16:13.742: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.339806091s May 15 01:16:15.745: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.343381761s May 15 01:16:17.748: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.346556938s May 15 01:16:19.751: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.349282815s May 15 01:16:21.755: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.352985336s May 15 01:16:23.758: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.356250502s May 15 01:16:25.762: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.360149839s May 15 01:16:27.765: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.363702409s May 15 01:16:29.769: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.367234878s May 15 01:16:31.772: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.370347686s May 15 01:16:33.775: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.373385438s May 15 01:16:35.777: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.375748934s May 15 01:16:37.781: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.379190007s May 15 01:16:39.786: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.383780336s May 15 01:16:41.789: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.386889746s May 15 01:16:43.791: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.389258128s May 15 01:16:45.795: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.393201332s May 15 01:16:47.797: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.395752052s May 15 01:16:49.800: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.39845971s May 15 01:16:51.804: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.40178082s May 15 01:16:53.806: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.404555813s May 15 01:16:55.809: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.407665975s May 15 01:16:57.812: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.410372952s May 15 01:16:59.816: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.414010126s May 15 01:17:01.819: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.416900242s May 15 01:17:03.822: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.419825811s May 15 01:17:05.825: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.423121988s May 15 01:17:07.828: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.426498089s May 15 01:17:09.831: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.429743473s May 15 01:17:11.837: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.435734316s May 15 01:17:13.840: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.438403026s May 15 01:17:15.843: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.441260283s May 15 01:17:17.847: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.445003095s May 15 01:17:19.850: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.448737127s May 15 01:17:21.853: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.451676829s May 15 01:17:23.857: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.455001485s May 15 01:17:25.860: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.45875147s May 15 01:17:27.864: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.462147099s May 15 01:17:29.867: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.465055344s May 15 01:17:31.870: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.468522219s May 15 01:17:33.874: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.472122498s May 15 01:17:35.878: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.475810232s May 15 01:17:37.881: INFO: Pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.479214668s May 15 01:17:39.890: INFO: Failed to get logs from node "node2" pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea" container "test-container": the server rejected our request for an unknown reason (get pods security-context-45058297-c7f3-4916-9b49-578f0288c9ea) STEP: delete the pod May 15 01:17:39.895: INFO: Waiting for pod security-context-45058297-c7f3-4916-9b49-578f0288c9ea to disappear May 15 01:17:39.897: INFO: Pod security-context-45058297-c7f3-4916-9b49-578f0288c9ea still exists May 15 01:17:41.898: INFO: Waiting for pod security-context-45058297-c7f3-4916-9b49-578f0288c9ea to disappear May 15 01:17:41.901: INFO: Pod security-context-45058297-c7f3-4916-9b49-578f0288c9ea still exists May 15 01:17:43.898: INFO: Waiting for pod security-context-45058297-c7f3-4916-9b49-578f0288c9ea to disappear May 15 01:17:43.900: INFO: Pod security-context-45058297-c7f3-4916-9b49-578f0288c9ea still exists May 15 01:17:45.899: INFO: Waiting for pod security-context-45058297-c7f3-4916-9b49-578f0288c9ea to disappear May 15 01:17:45.901: INFO: Pod security-context-45058297-c7f3-4916-9b49-578f0288c9ea no longer exists May 15 01:17:45.902: FAIL: Unexpected error: <*errors.errorString | 0xc0039531c0>: { s: "expected pod \"security-context-45058297-c7f3-4916-9b49-578f0288c9ea\" success: Gave up after waiting 5m0s for pod \"security-context-45058297-c7f3-4916-9b49-578f0288c9ea\" to be \"Succeeded or Failed\"", } expected pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea" success: Gave up after waiting 5m0s for pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00004e2c0, 0x4cb6256, 0x2b, 0xc001600800, 0x0, 0xc0024871b8, 0x2, 0x2, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/node.glob..func14.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:74 +0x19a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00297c180) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00297c180) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00297c180, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-7554". STEP: Found 9 events. May 15 01:17:45.907: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for security-context-45058297-c7f3-4916-9b49-578f0288c9ea: { } Scheduled: Successfully assigned security-context-7554/security-context-45058297-c7f3-4916-9b49-578f0288c9ea to node2 May 15 01:17:45.907: INFO: At 2021-05-15 01:12:51 +0000 UTC - event for security-context-45058297-c7f3-4916-9b49-578f0288c9ea: {multus } AddedInterface: Add eth0 [10.244.4.140/24] May 15 01:17:45.907: INFO: At 2021-05-15 01:12:51 +0000 UTC - event for security-context-45058297-c7f3-4916-9b49-578f0288c9ea: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:17:45.907: INFO: At 2021-05-15 01:12:54 +0000 UTC - event for security-context-45058297-c7f3-4916-9b49-578f0288c9ea: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:17:45.907: INFO: At 2021-05-15 01:12:54 +0000 UTC - event for security-context-45058297-c7f3-4916-9b49-578f0288c9ea: {kubelet node2} Failed: Error: ErrImagePull May 15 01:17:45.907: INFO: At 2021-05-15 01:12:55 +0000 UTC - event for security-context-45058297-c7f3-4916-9b49-578f0288c9ea: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 15 01:17:45.907: INFO: At 2021-05-15 01:12:57 +0000 UTC - event for security-context-45058297-c7f3-4916-9b49-578f0288c9ea: {multus } AddedInterface: Add eth0 [10.244.4.147/24] May 15 01:17:45.907: INFO: At 2021-05-15 01:12:57 +0000 UTC - event for security-context-45058297-c7f3-4916-9b49-578f0288c9ea: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:17:45.907: INFO: At 2021-05-15 01:12:57 +0000 UTC - event for security-context-45058297-c7f3-4916-9b49-578f0288c9ea: {kubelet node2} Failed: Error: ImagePullBackOff May 15 01:17:45.909: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:17:45.909: INFO: May 15 01:17:45.913: INFO: Logging node info for node master1 May 15 01:17:45.915: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 143754 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:45.916: INFO: Logging kubelet events for node master1 May 15 01:17:45.921: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:17:45.941: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.941: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:45.941: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.941: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:17:45.941: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.941: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:45.941: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.941: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:45.941: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:17:45.941: INFO: Container docker-registry ready: true, restart count 0 May 15 01:17:45.941: INFO: Container nginx ready: true, restart count 0 May 15 01:17:45.941: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.941: INFO: Container nfd-controller ready: true, restart count 0 May 15 01:17:45.941: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.941: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:45.941: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:45.941: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:45.941: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:45.941: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:45.941: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:45.941: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:45.941: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.941: INFO: Container kube-scheduler ready: true, restart count 0 W0515 01:17:45.953679 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:45.979: INFO: Latency metrics for node master1 May 15 01:17:45.979: INFO: Logging node info for node master2 May 15 01:17:45.982: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 143741 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:45.982: INFO: Logging kubelet events for node master2 May 15 01:17:45.987: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:17:45.996: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.996: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:45.996: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.996: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:17:45.996: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:45.996: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:45.996: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:45.996: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.996: INFO: Container autoscaler ready: true, restart count 2 May 15 01:17:45.996: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:45.996: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:45.996: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:45.996: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:17:45.996: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:45.996: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:17:45.996: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.996: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:45.996: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.996: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:45.996: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.996: INFO: Container coredns ready: true, restart count 0 May 15 01:17:45.996: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:45.996: INFO: Container kube-proxy ready: true, restart count 2 W0515 01:17:46.008324 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:46.038: INFO: Latency metrics for node master2 May 15 01:17:46.038: INFO: Logging node info for node master3 May 15 01:17:46.040: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 143730 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:36 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:46.040: INFO: Logging kubelet events for node master3 May 15 01:17:46.046: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:17:46.056: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.056: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:17:46.056: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:46.056: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:46.056: INFO: Container kube-flannel ready: true, restart count 2 May 15 01:17:46.056: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.056: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:46.056: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.056: INFO: Container coredns ready: true, restart count 0 May 15 01:17:46.056: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.056: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:46.056: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:46.056: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.056: INFO: Container kube-controller-manager ready: true, restart count 3 May 15 01:17:46.056: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.056: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:17:46.056: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.056: INFO: Container kube-apiserver ready: true, restart count 0 W0515 01:17:46.070132 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:46.095: INFO: Latency metrics for node master3 May 15 01:17:46.095: INFO: Logging node info for node node1 May 15 01:17:46.098: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 143757 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:46.099: INFO: Logging kubelet events for node node1 May 15 01:17:46.103: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:17:46.117: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:46.117: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:46.117: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:46.117: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:46.117: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:17:46.117: INFO: Container collectd ready: true, restart count 0 May 15 01:17:46.117: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:46.117: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:46.117: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:46.117: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:17:46.117: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:17:46.117: INFO: Container grafana ready: false, restart count 0 May 15 01:17:46.117: INFO: Container prometheus ready: false, restart count 22 May 15 01:17:46.117: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:17:46.117: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:17:46.117: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.117: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:46.117: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:46.117: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.117: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:46.117: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:46.117: INFO: security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container test-container ready: false, restart count 0 May 15 01:17:46.117: INFO: pod-submit-status-0-0 started at 2021-05-15 01:17:45 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container busybox ready: false, restart count 0 May 15 01:17:46.117: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:46.117: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:46.117: INFO: security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container test-container ready: false, restart count 0 May 15 01:17:46.117: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:46.117: INFO: downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a started at 2021-05-15 01:12:40 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container dapi-container ready: false, restart count 0 May 15 01:17:46.117: INFO: pod-submit-status-2-0 started at 2021-05-15 01:17:45 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container busybox ready: false, restart count 0 May 15 01:17:46.117: INFO: security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 started at 2021-05-15 01:13:13 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.117: INFO: Container test-container ready: false, restart count 0 W0515 01:17:46.130774 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:46.670: INFO: Latency metrics for node node1 May 15 01:17:46.670: INFO: Logging node info for node node2 May 15 01:17:46.674: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 143740 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:38 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:46.674: INFO: Logging kubelet events for node node2 May 15 01:17:46.678: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:17:46.790: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:17:46.790: INFO: Container discover ready: false, restart count 0 May 15 01:17:46.790: INFO: Container init ready: false, restart count 0 May 15 01:17:46.790: INFO: Container install ready: false, restart count 0 May 15 01:17:46.790: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:46.790: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:46.790: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:17:46.790: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:46.790: INFO: master started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container cntr ready: false, restart count 0 May 15 01:17:46.790: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:46.790: INFO: Init container install-cni ready: true, restart count 1 May 15 01:17:46.790: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:17:46.790: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.790: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:46.790: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:46.790: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.790: INFO: Container tas-controller ready: true, restart count 0 May 15 01:17:46.790: INFO: Container tas-extender ready: true, restart count 0 May 15 01:17:46.790: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:17:46.790: INFO: Container collectd ready: true, restart count 0 May 15 01:17:46.790: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:46.790: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:46.790: INFO: security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 started at 2021-05-15 01:12:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container test-container ready: false, restart count 0 May 15 01:17:46.790: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:46.790: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:46.790: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:17:46.790: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:46.790: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:46.790: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container cmk-webhook ready: true, restart count 0 May 15 01:17:46.790: INFO: pod-submit-remove-84d378b0-3001-4971-b893-6beedd97e9fa started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container agnhost-container ready: false, restart count 0 May 15 01:17:46.790: INFO: pod-submit-status-1-0 started at 2021-05-15 01:17:45 +0000 UTC (0+1 container statuses recorded) May 15 01:17:46.790: INFO: Container busybox ready: false, restart count 0 W0515 01:17:46.801494 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:46.845: INFO: Latency metrics for node node2 May 15 01:17:46.845: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-7554" for this suite. • Failure [307.492 seconds] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support pod.Spec.SecurityContext.SupplementalGroups [LinuxOnly] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:69 May 15 01:17:45.902: Unexpected error: <*errors.errorString | 0xc0039531c0>: { s: "expected pod \"security-context-45058297-c7f3-4916-9b49-578f0288c9ea\" success: Gave up after waiting 5m0s for pod \"security-context-45058297-c7f3-4916-9b49-578f0288c9ea\" to be \"Succeeded or Failed\"", } expected pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea" success: Gave up after waiting 5m0s for pod "security-context-45058297-c7f3-4916-9b49-578f0288c9ea" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] Security Context should support container.SecurityContext.RunAsUser And container.SecurityContext.RunAsGroup [LinuxOnly]","total":-1,"completed":0,"skipped":139,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support container.SecurityContext.RunAsUser And container.SecurityContext.RunAsGroup [LinuxOnly]"]} S ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] Security Context should support pod.Spec.SecurityContext.SupplementalGroups [LinuxOnly]","total":-1,"completed":0,"skipped":201,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support pod.Spec.SecurityContext.SupplementalGroups [LinuxOnly]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] SSH /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:17:47.086: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename ssh STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] [sig-node] SSH /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/ssh.go:36 May 15 01:17:47.106: INFO: Only supported for providers [gce gke aws local] (not skeleton) [AfterEach] [k8s.io] [sig-node] SSH /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 May 15 01:17:47.108: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "ssh-1111" for this suite. S [SKIPPING] in Spec Setup (BeforeEach) [0.034 seconds] [k8s.io] [sig-node] SSH /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should SSH to all nodes and run commands [BeforeEach] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/ssh.go:45 Only supported for providers [gce gke aws local] (not skeleton) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/ssh.go:38 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] crictl /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:17:47.547: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crictl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] [sig-node] crictl /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/crictl.go:33 May 15 01:17:47.571: INFO: Only supported for providers [gce gke] (not skeleton) [AfterEach] [k8s.io] [sig-node] crictl /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 May 15 01:17:47.573: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crictl-5790" for this suite. S [SKIPPING] in Spec Setup (BeforeEach) [0.033 seconds] [k8s.io] [sig-node] crictl /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should be able to run crictl on the node [BeforeEach] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/crictl.go:40 Only supported for providers [gce gke] (not skeleton) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/crictl.go:35 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] AppArmor /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:17:47.683: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename apparmor STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] load AppArmor profiles /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/apparmor.go:32 May 15 01:17:47.704: INFO: Only supported for node OS distro [gci ubuntu] (not debian) [AfterEach] load AppArmor profiles /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/apparmor.go:36 [AfterEach] [k8s.io] [sig-node] AppArmor /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 May 15 01:17:47.705: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "apparmor-5027" for this suite. S [SKIPPING] in Spec Setup (BeforeEach) [0.030 seconds] [k8s.io] [sig-node] AppArmor /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 load AppArmor profiles /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/apparmor.go:31 should enforce an AppArmor profile [BeforeEach] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/apparmor.go:43 Only supported for node OS distro [gci ubuntu] (not debian) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/skipper/skipper.go:266 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ May 15 01:17:47.933: INFO: Running AfterSuite actions on all nodes [BeforeEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.928: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [It] should provide host IP and pod IP as an env var if pod uses host network [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:109 STEP: Creating a pod to test downward api env vars May 15 01:12:39.962: INFO: Waiting up to 5m0s for pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a" in namespace "downward-api-3335" to be "Succeeded or Failed" May 15 01:12:39.964: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.18541ms May 15 01:12:41.967: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005185875s May 15 01:12:43.971: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.00913936s May 15 01:12:45.975: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013208474s May 15 01:12:47.979: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 8.016689503s May 15 01:12:49.983: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 10.020918457s May 15 01:12:51.988: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 12.025814342s May 15 01:12:53.991: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 14.029111854s May 15 01:12:55.995: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 16.03271368s May 15 01:12:57.999: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 18.036430528s May 15 01:13:00.001: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 20.039061045s May 15 01:13:02.006: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 22.044108471s May 15 01:13:04.010: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 24.047907672s May 15 01:13:06.014: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 26.051441731s May 15 01:13:08.018: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 28.056242083s May 15 01:13:10.023: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 30.060452921s May 15 01:13:12.028: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 32.066170553s May 15 01:13:14.032: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 34.070169709s May 15 01:13:16.037: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 36.074907402s May 15 01:13:18.040: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 38.078273491s May 15 01:13:20.045: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 40.082985144s May 15 01:13:22.050: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 42.087903087s May 15 01:13:24.055: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 44.092568129s May 15 01:13:26.058: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 46.096164537s May 15 01:13:28.062: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 48.100194806s May 15 01:13:30.067: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 50.104525509s May 15 01:13:32.071: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 52.10876063s May 15 01:13:34.075: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 54.112326406s May 15 01:13:36.079: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 56.117207925s May 15 01:13:38.084: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 58.12155711s May 15 01:13:40.088: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.125358062s May 15 01:13:42.092: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.129391686s May 15 01:13:44.096: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.133503649s May 15 01:13:46.099: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.137074926s May 15 01:13:48.103: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.141036084s May 15 01:13:50.107: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.144699681s May 15 01:13:52.111: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.149209059s May 15 01:13:54.115: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.152507253s May 15 01:13:56.119: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.156812079s May 15 01:13:58.123: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.160444419s May 15 01:14:00.126: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.163722293s May 15 01:14:02.130: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.168266422s May 15 01:14:04.134: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.171432702s May 15 01:14:06.137: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.174427598s May 15 01:14:08.140: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.177612376s May 15 01:14:10.143: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.180628768s May 15 01:14:12.146: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.183425256s May 15 01:14:14.149: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.186543162s May 15 01:14:16.152: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.189472382s May 15 01:14:18.155: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.193233005s May 15 01:14:20.158: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.196263465s May 15 01:14:22.162: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.200166191s May 15 01:14:24.167: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.204683787s May 15 01:14:26.171: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.209082483s May 15 01:14:28.176: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.213985884s May 15 01:14:30.180: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.217645205s May 15 01:14:32.183: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.221103279s May 15 01:14:34.187: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.225083636s May 15 01:14:36.190: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.228190373s May 15 01:14:38.194: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.232209892s May 15 01:14:40.198: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.236114157s May 15 01:14:42.202: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.240213582s May 15 01:14:44.205: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.2431946s May 15 01:14:46.209: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.24644464s May 15 01:14:48.214: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.251569121s May 15 01:14:50.217: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.254625318s May 15 01:14:52.220: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.257896492s May 15 01:14:54.224: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.261879908s May 15 01:14:56.229: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.266368919s May 15 01:14:58.232: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.269638076s May 15 01:15:00.236: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.273460288s May 15 01:15:02.239: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.276355725s May 15 01:15:04.242: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.279556595s May 15 01:15:06.244: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.282205931s May 15 01:15:08.248: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.28553884s May 15 01:15:10.251: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.288950014s May 15 01:15:12.254: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.292071881s May 15 01:15:14.259: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.29635641s May 15 01:15:16.262: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.299749567s May 15 01:15:18.265: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.302798191s May 15 01:15:20.270: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.307359818s May 15 01:15:22.273: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.310338735s May 15 01:15:24.275: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.312930979s May 15 01:15:26.279: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.31658037s May 15 01:15:28.283: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.320634848s May 15 01:15:30.287: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.325014668s May 15 01:15:32.291: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.328471631s May 15 01:15:34.295: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.332957639s May 15 01:15:36.300: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.337748132s May 15 01:15:38.304: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.341919753s May 15 01:15:40.308: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.346026287s May 15 01:15:42.312: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.349315269s May 15 01:15:44.314: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.35180399s May 15 01:15:46.319: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.356537729s May 15 01:15:48.324: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.361592754s May 15 01:15:50.330: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.367576328s May 15 01:15:52.332: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.370134668s May 15 01:15:54.336: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.374294355s May 15 01:15:56.341: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.379126273s May 15 01:15:58.345: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.383270451s May 15 01:16:00.350: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.387925968s May 15 01:16:02.354: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.391533054s May 15 01:16:04.357: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.395112811s May 15 01:16:06.361: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.399117388s May 15 01:16:08.365: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.402952989s May 15 01:16:10.370: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.408223636s May 15 01:16:12.374: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.411904774s May 15 01:16:14.377: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.41513955s May 15 01:16:16.381: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.419254142s May 15 01:16:18.385: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.422868832s May 15 01:16:20.390: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.427685835s May 15 01:16:22.393: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.430613309s May 15 01:16:24.396: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.43362426s May 15 01:16:26.400: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.437610182s May 15 01:16:28.403: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.440753941s May 15 01:16:30.407: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.44502111s May 15 01:16:32.410: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.4481697s May 15 01:16:34.413: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.450703845s May 15 01:16:36.416: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.453979521s May 15 01:16:38.423: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.460385528s May 15 01:16:40.427: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.464482672s May 15 01:16:42.430: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.467679365s May 15 01:16:44.435: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.472815138s May 15 01:16:46.440: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.477351917s May 15 01:16:48.443: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.481262749s May 15 01:16:50.447: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.484782561s May 15 01:16:52.451: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.488537518s May 15 01:16:54.455: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.492552183s May 15 01:16:56.460: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.498173602s May 15 01:16:58.464: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.501518192s May 15 01:17:00.468: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.505660893s May 15 01:17:02.471: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.50848453s May 15 01:17:04.475: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.512376835s May 15 01:17:06.479: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.517052086s May 15 01:17:08.483: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.520476797s May 15 01:17:10.485: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.523141146s May 15 01:17:12.489: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.526348664s May 15 01:17:14.492: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.529486158s May 15 01:17:16.494: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.532025766s May 15 01:17:18.499: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.536579532s May 15 01:17:20.503: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.541184104s May 15 01:17:22.506: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.544044161s May 15 01:17:24.510: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.547798041s May 15 01:17:26.513: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.551297704s May 15 01:17:28.517: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.554412416s May 15 01:17:30.521: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.559242696s May 15 01:17:32.524: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.562131695s May 15 01:17:34.528: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.565908481s May 15 01:17:36.531: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.568646796s May 15 01:17:38.534: INFO: Pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.571815269s May 15 01:17:40.543: INFO: Failed to get logs from node "node1" pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a" container "dapi-container": the server rejected our request for an unknown reason (get pods downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a) STEP: delete the pod May 15 01:17:40.548: INFO: Waiting for pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a to disappear May 15 01:17:40.550: INFO: Pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a still exists May 15 01:17:42.551: INFO: Waiting for pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a to disappear May 15 01:17:42.554: INFO: Pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a still exists May 15 01:17:44.551: INFO: Waiting for pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a to disappear May 15 01:17:44.554: INFO: Pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a still exists May 15 01:17:46.553: INFO: Waiting for pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a to disappear May 15 01:17:46.556: INFO: Pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a still exists May 15 01:17:48.551: INFO: Waiting for pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a to disappear May 15 01:17:48.554: INFO: Pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a still exists May 15 01:17:50.552: INFO: Waiting for pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a to disappear May 15 01:17:50.554: INFO: Pod downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a no longer exists May 15 01:17:50.554: FAIL: Unexpected error: <*errors.errorString | 0xc004294dc0>: { s: "expected pod \"downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a\" success: Gave up after waiting 5m0s for pod \"downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a\" to be \"Succeeded or Failed\"", } expected pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a" success: Gave up after waiting 5m0s for pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00004e580, 0x4c29f00, 0x15, 0xc004d00400, 0x0, 0xc001fc1198, 0x1, 0x1, 0x4de7490) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutputRegexp(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:532 k8s.io/kubernetes/test/e2e/common.testDownwardAPIUsingPod(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:425 k8s.io/kubernetes/test/e2e/common.glob..func5.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:155 +0x613 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001382c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001382c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001382c00, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "downward-api-3335". STEP: Found 6 events. May 15 01:17:50.559: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a: { } Scheduled: Successfully assigned downward-api-3335/downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a to node1 May 15 01:17:50.559: INFO: At 2021-05-15 01:12:45 +0000 UTC - event for downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:17:50.559: INFO: At 2021-05-15 01:12:47 +0000 UTC - event for downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:17:50.559: INFO: At 2021-05-15 01:12:47 +0000 UTC - event for downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a: {kubelet node1} Failed: Error: ErrImagePull May 15 01:17:50.559: INFO: At 2021-05-15 01:12:48 +0000 UTC - event for downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:17:50.559: INFO: At 2021-05-15 01:12:48 +0000 UTC - event for downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a: {kubelet node1} Failed: Error: ImagePullBackOff May 15 01:17:50.562: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:17:50.562: INFO: May 15 01:17:50.566: INFO: Logging node info for node master1 May 15 01:17:50.569: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 143754 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:40 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:50.569: INFO: Logging kubelet events for node master1 May 15 01:17:50.574: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:17:50.594: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.594: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:50.594: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:50.594: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:50.594: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:50.594: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:50.594: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:50.594: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:50.594: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.594: INFO: Container kube-scheduler ready: true, restart count 0 May 15 01:17:50.594: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.594: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:50.594: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.594: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:17:50.594: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.594: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:50.594: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.594: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:50.594: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:17:50.594: INFO: Container docker-registry ready: true, restart count 0 May 15 01:17:50.594: INFO: Container nginx ready: true, restart count 0 May 15 01:17:50.594: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.594: INFO: Container nfd-controller ready: true, restart count 0 W0515 01:17:50.608374 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:50.640: INFO: Latency metrics for node master1 May 15 01:17:50.640: INFO: Logging node info for node master2 May 15 01:17:50.641: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 143899 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:50.642: INFO: Logging kubelet events for node master2 May 15 01:17:50.647: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:17:50.657: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.657: INFO: Container autoscaler ready: true, restart count 2 May 15 01:17:50.657: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:50.657: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:50.657: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:50.657: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:17:50.657: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:50.657: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:17:50.657: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.657: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:50.657: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.657: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:50.657: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.657: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:17:50.657: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:50.657: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:50.657: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:50.657: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.657: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:50.657: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.657: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:50.657: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.657: INFO: Container coredns ready: true, restart count 0 W0515 01:17:50.671119 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:50.703: INFO: Latency metrics for node master2 May 15 01:17:50.703: INFO: Logging node info for node master3 May 15 01:17:50.705: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 143830 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:50.706: INFO: Logging kubelet events for node master3 May 15 01:17:50.710: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:17:50.718: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.718: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:17:50.718: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.718: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:50.718: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.718: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:17:50.718: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:50.718: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:50.718: INFO: Container kube-flannel ready: true, restart count 2 May 15 01:17:50.718: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.718: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:50.718: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.718: INFO: Container coredns ready: true, restart count 0 May 15 01:17:50.718: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:50.718: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:50.718: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:50.718: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.718: INFO: Container kube-controller-manager ready: true, restart count 3 W0515 01:17:50.731781 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:50.762: INFO: Latency metrics for node master3 May 15 01:17:50.762: INFO: Logging node info for node node1 May 15 01:17:50.765: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 143757 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:50.765: INFO: Logging kubelet events for node node1 May 15 01:17:50.769: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:17:50.781: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:17:50.781: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:50.781: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:50.781: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:17:50.781: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:50.781: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:50.781: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.781: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:50.781: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.781: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:50.781: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.781: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:50.781: INFO: security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 started at 2021-05-15 01:13:13 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.781: INFO: Container test-container ready: false, restart count 0 May 15 01:17:50.781: INFO: pod-submit-status-0-1 started at (0+0 container statuses recorded) May 15 01:17:50.781: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:50.781: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:50.781: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:50.781: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.781: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:50.781: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:17:50.781: INFO: Container collectd ready: true, restart count 0 May 15 01:17:50.781: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:50.781: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:50.781: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.781: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:50.781: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:17:50.781: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:17:50.781: INFO: Container grafana ready: false, restart count 0 May 15 01:17:50.781: INFO: Container prometheus ready: false, restart count 22 May 15 01:17:50.781: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:17:50.781: INFO: Container rules-configmap-reloader ready: true, restart count 0 W0515 01:17:50.792953 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:50.830: INFO: Latency metrics for node node1 May 15 01:17:50.830: INFO: Logging node info for node node2 May 15 01:17:50.833: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 143896 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:50.833: INFO: Logging kubelet events for node node2 May 15 01:17:50.839: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:17:50.851: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:50.851: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:17:50.851: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:50.851: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:50.851: INFO: pod-submit-status-2-1 started at 2021-05-15 01:17:47 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container busybox ready: false, restart count 0 May 15 01:17:50.851: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container cmk-webhook ready: true, restart count 0 May 15 01:17:50.851: INFO: pod-submit-remove-84d378b0-3001-4971-b893-6beedd97e9fa started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container agnhost-container ready: true, restart count 0 May 15 01:17:50.851: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:17:50.851: INFO: Container discover ready: false, restart count 0 May 15 01:17:50.851: INFO: Container init ready: false, restart count 0 May 15 01:17:50.851: INFO: Container install ready: false, restart count 0 May 15 01:17:50.851: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:17:50.851: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:50.851: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:50.851: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:50.851: INFO: master started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container cntr ready: false, restart count 0 May 15 01:17:50.851: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:50.851: INFO: Init container install-cni ready: true, restart count 1 May 15 01:17:50.851: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:17:50.851: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:50.851: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:50.851: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:50.851: INFO: pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321 started at 2021-05-15 01:17:47 +0000 UTC (1+1 container statuses recorded) May 15 01:17:50.851: INFO: Init container foo ready: false, restart count 0 May 15 01:17:50.851: INFO: Container bar ready: false, restart count 0 May 15 01:17:50.851: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:17:50.851: INFO: Container tas-controller ready: true, restart count 0 May 15 01:17:50.851: INFO: Container tas-extender ready: true, restart count 0 May 15 01:17:50.851: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:17:50.851: INFO: Container collectd ready: true, restart count 0 May 15 01:17:50.851: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:50.851: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:50.851: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:50.851: INFO: pod-submit-status-1-1 started at 2021-05-15 01:17:47 +0000 UTC (0+1 container statuses recorded) May 15 01:17:50.851: INFO: Container busybox ready: false, restart count 0 W0515 01:17:50.865556 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:50.903: INFO: Latency metrics for node node2 May 15 01:17:50.903: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-3335" for this suite. • Failure [310.984 seconds] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:34 should provide host IP and pod IP as an env var if pod uses host network [LinuxOnly] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:109 May 15 01:17:50.554: Unexpected error: <*errors.errorString | 0xc004294dc0>: { s: "expected pod \"downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a\" success: Gave up after waiting 5m0s for pod \"downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a\" to be \"Succeeded or Failed\"", } expected pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a" success: Gave up after waiting 5m0s for pod "downward-api-62459d35-581d-4ba3-ab46-7d81214a6c4a" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [sig-node] Downward API should provide host IP and pod IP as an env var if pod uses host network [LinuxOnly]","total":-1,"completed":1,"skipped":444,"failed":1,"failures":["[sig-node] Downward API should provide host IP and pod IP as an env var if pod uses host network [LinuxOnly]"]} May 15 01:17:50.925: INFO: Running AfterSuite actions on all nodes [BeforeEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:40.592: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context STEP: Waiting for a default service account to be provisioned in namespace [It] should support pod.Spec.SecurityContext.RunAsUser And pod.Spec.SecurityContext.RunAsGroup [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:89 STEP: Creating a pod to test pod.Spec.SecurityContext.RunAsUser May 15 01:12:40.626: INFO: Waiting up to 5m0s for pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86" in namespace "security-context-6750" to be "Succeeded or Failed" May 15 01:12:40.628: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2.535562ms May 15 01:12:42.632: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006257172s May 15 01:12:44.637: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4.011200805s May 15 01:12:46.641: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 6.014590146s May 15 01:12:48.643: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 8.017339479s May 15 01:12:50.648: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 10.022373253s May 15 01:12:52.651: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 12.025153337s May 15 01:12:54.655: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 14.029009618s May 15 01:12:56.661: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 16.034612698s May 15 01:12:58.663: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 18.037051912s May 15 01:13:00.670: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 20.043780551s May 15 01:13:02.674: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 22.047797001s May 15 01:13:04.679: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 24.05348448s May 15 01:13:06.685: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 26.059442894s May 15 01:13:08.688: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 28.06252175s May 15 01:13:10.695: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 30.068762626s May 15 01:13:12.698: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 32.072409701s May 15 01:13:14.704: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 34.078243367s May 15 01:13:16.710: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 36.084522885s May 15 01:13:18.715: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 38.088599206s May 15 01:13:20.722: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 40.095610913s May 15 01:13:22.727: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 42.100551326s May 15 01:13:24.731: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 44.104735625s May 15 01:13:26.736: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 46.110402967s May 15 01:13:28.740: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 48.114130813s May 15 01:13:30.746: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 50.120258732s May 15 01:13:32.751: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 52.124612441s May 15 01:13:34.755: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 54.129327291s May 15 01:13:36.762: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 56.136406853s May 15 01:13:38.765: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 58.139537835s May 15 01:13:40.769: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.142814621s May 15 01:13:42.773: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.146806814s May 15 01:13:44.778: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.152334443s May 15 01:13:46.785: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.158598094s May 15 01:13:48.789: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.162815833s May 15 01:13:50.796: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.169882999s May 15 01:13:52.801: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.17485875s May 15 01:13:54.805: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.179346556s May 15 01:13:56.812: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.185875349s May 15 01:13:58.816: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.190263323s May 15 01:14:00.824: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.197837809s May 15 01:14:02.828: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.201816623s May 15 01:14:04.832: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.206384342s May 15 01:14:06.839: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.213033776s May 15 01:14:08.843: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.216617427s May 15 01:14:10.847: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.220779159s May 15 01:14:12.851: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.225029116s May 15 01:14:14.856: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.229950463s May 15 01:14:16.861: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.234726689s May 15 01:14:18.864: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.23761184s May 15 01:14:20.870: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.243640421s May 15 01:14:22.874: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.248266459s May 15 01:14:24.880: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.253656856s May 15 01:14:26.883: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.257120909s May 15 01:14:28.886: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.259877408s May 15 01:14:30.892: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.265932415s May 15 01:14:32.896: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.269982767s May 15 01:14:34.900: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.27435322s May 15 01:14:36.904: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.278051889s May 15 01:14:38.906: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.280521912s May 15 01:14:40.911: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.284955669s May 15 01:14:42.916: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.29031872s May 15 01:14:44.920: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.293960035s May 15 01:14:46.924: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.297692989s May 15 01:14:48.928: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.301855964s May 15 01:14:50.931: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.304643641s May 15 01:14:52.935: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.309187296s May 15 01:14:54.941: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.315165383s May 15 01:14:56.947: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.320662078s May 15 01:14:58.951: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.32506087s May 15 01:15:00.957: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.331042838s May 15 01:15:02.961: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.335357819s May 15 01:15:04.964: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.338134639s May 15 01:15:06.970: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.343745672s May 15 01:15:08.973: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.347529978s May 15 01:15:10.979: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.353251189s May 15 01:15:12.984: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.358268115s May 15 01:15:14.989: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.362974123s May 15 01:15:16.994: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.368337447s May 15 01:15:18.998: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.372236227s May 15 01:15:21.006: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.380191203s May 15 01:15:23.012: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.385723361s May 15 01:15:25.018: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.392013033s May 15 01:15:27.024: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.397910759s May 15 01:15:29.028: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.402212613s May 15 01:15:31.035: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.409142735s May 15 01:15:33.038: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.412334727s May 15 01:15:35.044: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.417994324s May 15 01:15:37.050: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.424257485s May 15 01:15:39.054: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.428274014s May 15 01:15:41.063: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.436723978s May 15 01:15:43.071: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.445323826s May 15 01:15:45.077: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.450741681s May 15 01:15:47.084: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.458282373s May 15 01:15:49.089: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.462556331s May 15 01:15:51.093: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.467446536s May 15 01:15:53.098: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.47211318s May 15 01:15:55.105: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.479320779s May 15 01:15:57.110: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.483660293s May 15 01:15:59.115: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.489246366s May 15 01:16:01.119: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.49255127s May 15 01:16:03.122: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.496531803s May 15 01:16:05.128: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.501978497s May 15 01:16:07.133: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.506732309s May 15 01:16:09.136: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.509808739s May 15 01:16:11.142: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.515704154s May 15 01:16:13.146: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.519795428s May 15 01:16:15.150: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.524152308s May 15 01:16:17.153: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.527502031s May 15 01:16:19.158: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.531873121s May 15 01:16:21.162: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.535877709s May 15 01:16:23.166: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.539819824s May 15 01:16:25.170: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.544356567s May 15 01:16:27.178: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.552424727s May 15 01:16:29.183: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.557397339s May 15 01:16:31.191: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.564734226s May 15 01:16:33.195: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.569031081s May 15 01:16:35.199: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.573243772s May 15 01:16:37.202: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.575915911s May 15 01:16:39.205: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.579471478s May 15 01:16:41.210: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.583590719s May 15 01:16:43.214: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.587615106s May 15 01:16:45.217: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.591393993s May 15 01:16:47.221: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.594639515s May 15 01:16:49.224: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.598497689s May 15 01:16:51.230: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.604181958s May 15 01:16:53.233: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.607197145s May 15 01:16:55.238: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.611807865s May 15 01:16:57.241: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.615010782s May 15 01:16:59.245: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.619446598s May 15 01:17:01.249: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.623255253s May 15 01:17:03.254: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.627656469s May 15 01:17:05.257: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.631185299s May 15 01:17:07.261: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.634875785s May 15 01:17:09.264: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.638385655s May 15 01:17:11.271: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.644727374s May 15 01:17:13.275: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.648745327s May 15 01:17:15.279: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.652795684s May 15 01:17:17.282: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.655984807s May 15 01:17:19.286: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.659633712s May 15 01:17:21.289: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.66320109s May 15 01:17:23.293: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.667515359s May 15 01:17:25.297: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.670830147s May 15 01:17:27.301: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.674556453s May 15 01:17:29.304: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.677731169s May 15 01:17:31.309: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.682551073s May 15 01:17:33.312: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.686404332s May 15 01:17:35.316: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.689950873s May 15 01:17:37.320: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.694016295s May 15 01:17:39.325: INFO: Pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.698882338s May 15 01:17:41.332: INFO: Failed to get logs from node "node1" pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86" container "test-container": the server rejected our request for an unknown reason (get pods security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86) STEP: delete the pod May 15 01:17:41.336: INFO: Waiting for pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 to disappear May 15 01:17:41.338: INFO: Pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 still exists May 15 01:17:43.339: INFO: Waiting for pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 to disappear May 15 01:17:43.341: INFO: Pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 still exists May 15 01:17:45.338: INFO: Waiting for pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 to disappear May 15 01:17:45.341: INFO: Pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 still exists May 15 01:17:47.338: INFO: Waiting for pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 to disappear May 15 01:17:47.340: INFO: Pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 still exists May 15 01:17:49.338: INFO: Waiting for pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 to disappear May 15 01:17:49.341: INFO: Pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 still exists May 15 01:17:51.339: INFO: Waiting for pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 to disappear May 15 01:17:51.342: INFO: Pod security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 no longer exists May 15 01:17:51.343: FAIL: Unexpected error: <*errors.errorString | 0xc0029356d0>: { s: "expected pod \"security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86\" success: Gave up after waiting 5m0s for pod \"security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86\" to be \"Succeeded or Failed\"", } expected pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86" success: Gave up after waiting 5m0s for pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000cb5b80, 0x4c7f1fb, 0x22, 0xc00508e000, 0x0, 0xc0047d51b8, 0x2, 0x2, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/node.glob..func14.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:97 +0x2f2 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002832d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002832d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc002832d80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-6750". STEP: Found 9 events. May 15 01:17:51.348: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86: { } Scheduled: Successfully assigned security-context-6750/security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86 to node1 May 15 01:17:51.348: INFO: At 2021-05-15 01:12:50 +0000 UTC - event for security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86: {multus } AddedInterface: Add eth0 [10.244.3.58/24] May 15 01:17:51.348: INFO: At 2021-05-15 01:12:51 +0000 UTC - event for security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:17:51.348: INFO: At 2021-05-15 01:12:52 +0000 UTC - event for security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:17:51.348: INFO: At 2021-05-15 01:12:52 +0000 UTC - event for security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86: {kubelet node1} Failed: Error: ErrImagePull May 15 01:17:51.348: INFO: At 2021-05-15 01:12:52 +0000 UTC - event for security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 15 01:17:51.348: INFO: At 2021-05-15 01:12:54 +0000 UTC - event for security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86: {multus } AddedInterface: Add eth0 [10.244.3.61/24] May 15 01:17:51.348: INFO: At 2021-05-15 01:12:54 +0000 UTC - event for security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:17:51.348: INFO: At 2021-05-15 01:12:54 +0000 UTC - event for security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86: {kubelet node1} Failed: Error: ImagePullBackOff May 15 01:17:51.350: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:17:51.351: INFO: May 15 01:17:51.354: INFO: Logging node info for node master1 May 15 01:17:51.357: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 143973 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:51.358: INFO: Logging kubelet events for node master1 May 15 01:17:51.362: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:17:51.371: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.372: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:51.372: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:51.372: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.372: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.372: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:51.372: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.372: INFO: Container kube-scheduler ready: true, restart count 0 May 15 01:17:51.372: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.372: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:51.372: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.372: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:17:51.372: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.372: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:51.372: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.372: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:51.372: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.372: INFO: Container docker-registry ready: true, restart count 0 May 15 01:17:51.372: INFO: Container nginx ready: true, restart count 0 May 15 01:17:51.372: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.372: INFO: Container nfd-controller ready: true, restart count 0 May 15 01:17:51.372: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.372: INFO: Container kube-apiserver ready: true, restart count 0 W0515 01:17:51.385064 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:51.412: INFO: Latency metrics for node master1 May 15 01:17:51.412: INFO: Logging node info for node master2 May 15 01:17:51.414: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 143899 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:51.414: INFO: Logging kubelet events for node master2 May 15 01:17:51.419: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:17:51.428: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.428: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:51.428: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.428: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:51.428: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.428: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:17:51.428: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.428: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:51.428: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:51.428: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.428: INFO: Container autoscaler ready: true, restart count 2 May 15 01:17:51.428: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.428: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.428: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:51.428: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.428: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.428: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:17:51.428: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.428: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:51.428: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.428: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:51.428: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.428: INFO: Container coredns ready: true, restart count 0 W0515 01:17:51.442110 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:51.471: INFO: Latency metrics for node master2 May 15 01:17:51.471: INFO: Logging node info for node master3 May 15 01:17:51.473: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 143830 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:51.473: INFO: Logging kubelet events for node master3 May 15 01:17:51.479: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:17:51.485: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.486: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:51.486: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.486: INFO: Container coredns ready: true, restart count 0 May 15 01:17:51.486: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.486: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.486: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:51.486: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.486: INFO: Container kube-controller-manager ready: true, restart count 3 May 15 01:17:51.486: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.486: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:17:51.486: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.486: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:51.486: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.486: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:17:51.486: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.486: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:51.486: INFO: Container kube-flannel ready: true, restart count 2 W0515 01:17:51.498995 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:51.527: INFO: Latency metrics for node master3 May 15 01:17:51.527: INFO: Logging node info for node node1 May 15 01:17:51.529: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 143757 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:51.530: INFO: Logging kubelet events for node node1 May 15 01:17:51.534: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:17:51.546: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.546: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:51.546: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:51.546: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.546: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:51.546: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:17:51.546: INFO: Container collectd ready: true, restart count 0 May 15 01:17:51.546: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:51.546: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:51.546: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.546: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:51.546: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:17:51.546: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:17:51.546: INFO: Container grafana ready: false, restart count 0 May 15 01:17:51.546: INFO: Container prometheus ready: false, restart count 22 May 15 01:17:51.547: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:17:51.547: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:17:51.547: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.547: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.547: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:51.547: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.547: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:51.547: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:51.547: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.547: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:51.547: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.547: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:51.547: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.547: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:51.547: INFO: security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 started at 2021-05-15 01:13:13 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.547: INFO: Container test-container ready: false, restart count 0 May 15 01:17:51.547: INFO: pod-submit-status-0-1 started at 2021-05-15 01:17:50 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.547: INFO: Container busybox ready: false, restart count 0 W0515 01:17:51.560217 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:51.595: INFO: Latency metrics for node node1 May 15 01:17:51.595: INFO: Logging node info for node node2 May 15 01:17:51.597: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 143896 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:51.598: INFO: Logging kubelet events for node node2 May 15 01:17:51.603: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:17:51.614: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.614: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:51.614: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.614: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:51.614: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:51.614: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.614: INFO: Container cmk-webhook ready: true, restart count 0 May 15 01:17:51.614: INFO: pod-submit-remove-84d378b0-3001-4971-b893-6beedd97e9fa started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.614: INFO: Container agnhost-container ready: true, restart count 0 May 15 01:17:51.614: INFO: pod-submit-status-1-2 started at (0+0 container statuses recorded) May 15 01:17:51.614: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:17:51.614: INFO: Container discover ready: false, restart count 0 May 15 01:17:51.614: INFO: Container init ready: false, restart count 0 May 15 01:17:51.614: INFO: Container install ready: false, restart count 0 May 15 01:17:51.614: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.614: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:51.614: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.614: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:51.614: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.614: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:17:51.614: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.614: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:51.614: INFO: master started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.614: INFO: Container cntr ready: false, restart count 0 May 15 01:17:51.614: INFO: pod-submit-status-2-2 started at (0+0 container statuses recorded) May 15 01:17:51.614: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.614: INFO: Init container install-cni ready: true, restart count 1 May 15 01:17:51.614: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:17:51.614: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.614: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.614: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:51.614: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.614: INFO: Container tas-controller ready: true, restart count 0 May 15 01:17:51.615: INFO: Container tas-extender ready: true, restart count 0 May 15 01:17:51.615: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:17:51.615: INFO: Container collectd ready: true, restart count 0 May 15 01:17:51.615: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:51.615: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:51.615: INFO: pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321 started at 2021-05-15 01:17:47 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.615: INFO: Init container foo ready: false, restart count 0 May 15 01:17:51.615: INFO: Container bar ready: false, restart count 0 May 15 01:17:51.615: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.615: INFO: Container kube-sriovdp ready: true, restart count 0 W0515 01:17:51.626064 24 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:51.655: INFO: Latency metrics for node node2 May 15 01:17:51.655: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-6750" for this suite. • Failure [311.072 seconds] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support pod.Spec.SecurityContext.RunAsUser And pod.Spec.SecurityContext.RunAsGroup [LinuxOnly] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:89 May 15 01:17:51.343: Unexpected error: <*errors.errorString | 0xc0029356d0>: { s: "expected pod \"security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86\" success: Gave up after waiting 5m0s for pod \"security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86\" to be \"Succeeded or Failed\"", } expected pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86" success: Gave up after waiting 5m0s for pod "security-context-0e84a6dd-4632-48be-ad2b-c3b7084d1c86" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ [BeforeEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:40.753: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context May 15 01:12:40.773: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 15 01:12:40.775: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should support container.SecurityContext.RunAsUser [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:103 STEP: Creating a pod to test pod.Spec.SecurityContext.RunAsUser May 15 01:12:40.792: INFO: Waiting up to 5m0s for pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9" in namespace "security-context-4472" to be "Succeeded or Failed" May 15 01:12:40.795: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.165932ms May 15 01:12:42.798: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005914045s May 15 01:12:44.804: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4.011634434s May 15 01:12:46.809: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 6.01691578s May 15 01:12:48.812: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 8.019588789s May 15 01:12:50.816: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 10.023757432s May 15 01:12:52.821: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 12.028653455s May 15 01:12:54.825: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 14.031994964s May 15 01:12:56.827: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 16.034714926s May 15 01:12:58.831: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 18.03804693s May 15 01:13:00.834: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 20.041800466s May 15 01:13:02.837: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 22.04479548s May 15 01:13:04.844: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 24.051060044s May 15 01:13:06.851: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 26.057998267s May 15 01:13:08.854: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 28.061352232s May 15 01:13:10.857: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 30.064141557s May 15 01:13:12.859: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 32.066784681s May 15 01:13:14.864: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 34.070982691s May 15 01:13:16.868: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 36.075399376s May 15 01:13:18.871: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 38.07876573s May 15 01:13:20.877: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 40.084616546s May 15 01:13:22.881: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 42.088263631s May 15 01:13:24.885: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 44.092229568s May 15 01:13:26.889: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 46.096294036s May 15 01:13:28.893: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 48.100137424s May 15 01:13:30.899: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 50.10651662s May 15 01:13:32.904: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 52.111448332s May 15 01:13:34.908: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 54.115274973s May 15 01:13:36.913: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 56.120301462s May 15 01:13:38.916: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 58.123467496s May 15 01:13:40.921: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.128117263s May 15 01:13:42.924: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.131239009s May 15 01:13:44.928: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.135930163s May 15 01:13:46.933: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.140844651s May 15 01:13:48.936: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.143283482s May 15 01:13:50.941: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.148012277s May 15 01:13:52.945: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.152481276s May 15 01:13:54.949: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.156885351s May 15 01:13:56.954: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.161289951s May 15 01:13:58.957: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.164419036s May 15 01:14:00.961: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.168909106s May 15 01:14:02.966: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.173819221s May 15 01:14:04.971: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.178135489s May 15 01:14:06.975: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.182264163s May 15 01:14:08.978: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.185570535s May 15 01:14:10.981: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.188749883s May 15 01:14:12.984: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.191094037s May 15 01:14:14.989: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.196543311s May 15 01:14:16.994: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.201917792s May 15 01:14:18.997: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.20491291s May 15 01:14:21.002: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.209123565s May 15 01:14:23.006: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.213447714s May 15 01:14:25.012: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.219094841s May 15 01:14:27.016: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.223869718s May 15 01:14:29.019: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.226920977s May 15 01:14:31.023: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.230676451s May 15 01:14:33.027: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.233979354s May 15 01:14:35.031: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.238098194s May 15 01:14:37.034: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.241086356s May 15 01:14:39.038: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.245286937s May 15 01:14:41.043: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.250083161s May 15 01:14:43.046: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.253483872s May 15 01:14:45.050: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.257802797s May 15 01:14:47.055: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.262014582s May 15 01:14:49.058: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.265439915s May 15 01:14:51.062: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.269624138s May 15 01:14:53.067: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.274475918s May 15 01:14:55.071: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.278699527s May 15 01:14:57.075: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.28260951s May 15 01:14:59.079: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.286083455s May 15 01:15:01.083: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.289985503s May 15 01:15:03.086: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.293369471s May 15 01:15:05.090: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.297873521s May 15 01:15:07.095: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.302114642s May 15 01:15:09.098: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.305002777s May 15 01:15:11.103: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.310086988s May 15 01:15:13.106: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.313835759s May 15 01:15:15.111: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.318259736s May 15 01:15:17.116: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.3231543s May 15 01:15:19.119: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.326102085s May 15 01:15:21.123: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.330148642s May 15 01:15:23.128: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.335885512s May 15 01:15:25.133: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.340598741s May 15 01:15:27.137: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.344839927s May 15 01:15:29.141: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.348775922s May 15 01:15:31.146: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.353357199s May 15 01:15:33.150: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.357410017s May 15 01:15:35.156: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.363354018s May 15 01:15:37.160: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.367853972s May 15 01:15:39.164: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.371124156s May 15 01:15:41.168: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.375444233s May 15 01:15:43.171: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.378581819s May 15 01:15:45.177: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.384821145s May 15 01:15:47.182: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.389095078s May 15 01:15:49.184: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.39163024s May 15 01:15:51.188: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.395838497s May 15 01:15:53.192: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.399672702s May 15 01:15:55.197: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.404621783s May 15 01:15:57.205: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.412195569s May 15 01:15:59.210: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.417060066s May 15 01:16:01.214: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.421523254s May 15 01:16:03.218: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.425632315s May 15 01:16:05.223: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.430422292s May 15 01:16:07.225: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.432901111s May 15 01:16:09.229: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.436021457s May 15 01:16:11.232: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.439300437s May 15 01:16:13.235: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.442341705s May 15 01:16:15.238: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.445091373s May 15 01:16:17.241: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.448598601s May 15 01:16:19.244: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.451687012s May 15 01:16:21.248: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.4553305s May 15 01:16:23.253: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.460930135s May 15 01:16:25.258: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.465056899s May 15 01:16:27.261: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.468071112s May 15 01:16:29.264: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.471601772s May 15 01:16:31.271: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.478827192s May 15 01:16:33.275: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.482802312s May 15 01:16:35.282: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.489236149s May 15 01:16:37.285: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.492690492s May 15 01:16:39.290: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.4976116s May 15 01:16:41.294: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.501849086s May 15 01:16:43.298: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.505444099s May 15 01:16:45.301: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.508906999s May 15 01:16:47.305: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.51226918s May 15 01:16:49.309: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.516000748s May 15 01:16:51.314: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.521488093s May 15 01:16:53.317: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.524939984s May 15 01:16:55.322: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.529047308s May 15 01:16:57.325: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.532331753s May 15 01:16:59.330: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.537330614s May 15 01:17:01.333: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.540018655s May 15 01:17:03.338: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.54514621s May 15 01:17:05.341: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.548402326s May 15 01:17:07.344: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.551329046s May 15 01:17:09.347: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.55488098s May 15 01:17:11.354: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.561243798s May 15 01:17:13.357: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.564318624s May 15 01:17:15.361: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.568406429s May 15 01:17:17.364: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.571083622s May 15 01:17:19.367: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.574263785s May 15 01:17:21.370: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.57706091s May 15 01:17:23.377: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.584057444s May 15 01:17:25.379: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.586912948s May 15 01:17:27.383: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.590677942s May 15 01:17:29.387: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.593995332s May 15 01:17:31.394: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.601461444s May 15 01:17:33.397: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.604763053s May 15 01:17:35.402: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.609610033s May 15 01:17:37.405: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.612265555s May 15 01:17:39.410: INFO: Pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.617016492s May 15 01:17:41.417: INFO: Failed to get logs from node "node1" pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9" container "test-container": the server rejected our request for an unknown reason (get pods security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9) STEP: delete the pod May 15 01:17:41.422: INFO: Waiting for pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 to disappear May 15 01:17:41.424: INFO: Pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 still exists May 15 01:17:43.425: INFO: Waiting for pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 to disappear May 15 01:17:43.429: INFO: Pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 still exists May 15 01:17:45.425: INFO: Waiting for pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 to disappear May 15 01:17:45.429: INFO: Pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 still exists May 15 01:17:47.425: INFO: Waiting for pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 to disappear May 15 01:17:47.427: INFO: Pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 still exists May 15 01:17:49.425: INFO: Waiting for pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 to disappear May 15 01:17:49.428: INFO: Pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 still exists May 15 01:17:51.425: INFO: Waiting for pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 to disappear May 15 01:17:51.427: INFO: Pod security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 no longer exists May 15 01:17:51.428: FAIL: Unexpected error: <*errors.errorString | 0xc00495ad10>: { s: "expected pod \"security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9\" success: Gave up after waiting 5m0s for pod \"security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9\" to be \"Succeeded or Failed\"", } expected pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9" success: Gave up after waiting 5m0s for pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0016bd080, 0x4c7f1fb, 0x22, 0xc000181000, 0x0, 0xc0048551b8, 0x2, 0x2, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/node.glob..func14.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:112 +0x345 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002909800) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002909800) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc002909800, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-4472". STEP: Found 7 events. May 15 01:17:51.432: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9: { } Scheduled: Successfully assigned security-context-4472/security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9 to node1 May 15 01:17:51.432: INFO: At 2021-05-15 01:12:50 +0000 UTC - event for security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9: {multus } AddedInterface: Add eth0 [10.244.3.59/24] May 15 01:17:51.432: INFO: At 2021-05-15 01:12:51 +0000 UTC - event for security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:17:51.432: INFO: At 2021-05-15 01:12:53 +0000 UTC - event for security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:17:51.432: INFO: At 2021-05-15 01:12:53 +0000 UTC - event for security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9: {kubelet node1} Failed: Error: ErrImagePull May 15 01:17:51.432: INFO: At 2021-05-15 01:12:54 +0000 UTC - event for security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:17:51.432: INFO: At 2021-05-15 01:12:54 +0000 UTC - event for security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9: {kubelet node1} Failed: Error: ImagePullBackOff May 15 01:17:51.434: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:17:51.434: INFO: May 15 01:17:51.438: INFO: Logging node info for node master1 May 15 01:17:51.441: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 143973 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:51.441: INFO: Logging kubelet events for node master1 May 15 01:17:51.446: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:17:51.465: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.465: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:51.465: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.465: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:51.465: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:51.465: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.465: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.465: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:51.465: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.465: INFO: Container kube-scheduler ready: true, restart count 0 May 15 01:17:51.465: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.465: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:51.465: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.465: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:17:51.465: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.465: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:51.465: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.465: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:51.465: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.465: INFO: Container docker-registry ready: true, restart count 0 May 15 01:17:51.465: INFO: Container nginx ready: true, restart count 0 May 15 01:17:51.465: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.465: INFO: Container nfd-controller ready: true, restart count 0 W0515 01:17:51.478847 22 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:51.504: INFO: Latency metrics for node master1 May 15 01:17:51.504: INFO: Logging node info for node master2 May 15 01:17:51.506: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 143899 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:51.506: INFO: Logging kubelet events for node master2 May 15 01:17:51.511: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:17:51.520: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.520: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:51.520: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.520: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:51.520: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.520: INFO: Container coredns ready: true, restart count 0 May 15 01:17:51.520: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.520: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.520: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:51.520: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.520: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.520: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:17:51.520: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.520: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:51.520: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.520: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:51.520: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.520: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:17:51.520: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.520: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:51.521: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:51.521: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.521: INFO: Container autoscaler ready: true, restart count 2 W0515 01:17:51.532380 22 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:51.556: INFO: Latency metrics for node master2 May 15 01:17:51.556: INFO: Logging node info for node master3 May 15 01:17:51.558: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 143830 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:51.558: INFO: Logging kubelet events for node master3 May 15 01:17:51.564: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:17:51.572: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.572: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:51.572: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.572: INFO: Container coredns ready: true, restart count 0 May 15 01:17:51.572: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.572: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.572: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:51.572: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.572: INFO: Container kube-controller-manager ready: true, restart count 3 May 15 01:17:51.572: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.572: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:17:51.572: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.572: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:51.572: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.572: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:17:51.572: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.572: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:51.572: INFO: Container kube-flannel ready: true, restart count 2 W0515 01:17:51.585384 22 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:51.611: INFO: Latency metrics for node master3 May 15 01:17:51.611: INFO: Logging node info for node node1 May 15 01:17:51.613: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 143757 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:42 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:51.614: INFO: Logging kubelet events for node node1 May 15 01:17:51.619: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:17:51.630: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:17:51.630: INFO: Container collectd ready: true, restart count 0 May 15 01:17:51.630: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:51.630: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:51.630: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.630: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:51.630: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:51.630: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.630: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:51.630: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.630: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:51.630: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:17:51.630: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:17:51.630: INFO: Container grafana ready: false, restart count 0 May 15 01:17:51.630: INFO: Container prometheus ready: false, restart count 22 May 15 01:17:51.630: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:17:51.630: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:17:51.630: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.630: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.630: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:51.630: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.630: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:51.630: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:51.630: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.630: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:51.630: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.630: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:51.630: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.630: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:51.630: INFO: security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 started at 2021-05-15 01:13:13 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.630: INFO: Container test-container ready: false, restart count 0 May 15 01:17:51.630: INFO: pod-submit-status-0-1 started at 2021-05-15 01:17:50 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.630: INFO: Container busybox ready: false, restart count 0 W0515 01:17:51.643782 22 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:51.676: INFO: Latency metrics for node node1 May 15 01:17:51.676: INFO: Logging node info for node node2 May 15 01:17:51.679: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 143896 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:51.679: INFO: Logging kubelet events for node node2 May 15 01:17:51.684: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:17:51.693: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.693: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:51.693: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:51.693: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.693: INFO: Init container install-cni ready: true, restart count 1 May 15 01:17:51.693: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:17:51.693: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:17:51.693: INFO: Container collectd ready: true, restart count 0 May 15 01:17:51.694: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:51.694: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:51.694: INFO: pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321 started at 2021-05-15 01:17:47 +0000 UTC (1+1 container statuses recorded) May 15 01:17:51.694: INFO: Init container foo ready: false, restart count 0 May 15 01:17:51.694: INFO: Container bar ready: false, restart count 0 May 15 01:17:51.694: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.694: INFO: Container tas-controller ready: true, restart count 0 May 15 01:17:51.694: INFO: Container tas-extender ready: true, restart count 0 May 15 01:17:51.694: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.694: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:51.694: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:17:51.694: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:51.694: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:51.694: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.694: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:51.694: INFO: pod-submit-remove-84d378b0-3001-4971-b893-6beedd97e9fa started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.694: INFO: Container agnhost-container ready: true, restart count 0 May 15 01:17:51.694: INFO: pod-submit-status-1-2 started at (0+0 container statuses recorded) May 15 01:17:51.694: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.694: INFO: Container cmk-webhook ready: true, restart count 0 May 15 01:17:51.694: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:17:51.694: INFO: Container discover ready: false, restart count 0 May 15 01:17:51.694: INFO: Container init ready: false, restart count 0 May 15 01:17:51.694: INFO: Container install ready: false, restart count 0 May 15 01:17:51.694: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.694: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:51.694: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.694: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:17:51.694: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.694: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:51.694: INFO: master started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.694: INFO: Container cntr ready: false, restart count 0 May 15 01:17:51.694: INFO: pod-submit-status-2-2 started at (0+0 container statuses recorded) May 15 01:17:51.694: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:51.694: INFO: Container nginx-proxy ready: true, restart count 2 W0515 01:17:51.707486 22 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:51.750: INFO: Latency metrics for node node2 May 15 01:17:51.750: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-4472" for this suite. • Failure [311.007 seconds] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support container.SecurityContext.RunAsUser [LinuxOnly] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:103 May 15 01:17:51.428: Unexpected error: <*errors.errorString | 0xc00495ad10>: { s: "expected pod \"security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9\" success: Gave up after waiting 5m0s for pod \"security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9\" to be \"Succeeded or Failed\"", } expected pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9" success: Gave up after waiting 5m0s for pod "security-context-621c6218-86b3-4bc9-b0af-a6b6d19c2df9" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] Security Context should support container.SecurityContext.RunAsUser [LinuxOnly]","total":-1,"completed":0,"skipped":928,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support container.SecurityContext.RunAsUser [LinuxOnly]"]} May 15 01:17:51.765: INFO: Running AfterSuite actions on all nodes [BeforeEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:12:39.536: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context May 15 01:12:39.554: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 15 01:12:39.556: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should support seccomp default which is unconfined [Feature:Seccomp] [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:174 STEP: Creating a pod to test seccomp.security.alpha.kubernetes.io/pod May 15 01:12:39.572: INFO: Waiting up to 5m0s for pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6" in namespace "security-context-4205" to be "Succeeded or Failed" May 15 01:12:39.575: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.907529ms May 15 01:12:41.579: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006096997s May 15 01:12:43.582: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.00910668s May 15 01:12:45.585: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.01285367s May 15 01:12:47.588: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015307456s May 15 01:12:49.590: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 10.017714178s May 15 01:12:51.593: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 12.020749375s May 15 01:12:53.597: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 14.024460554s May 15 01:12:55.604: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 16.031069542s May 15 01:12:57.607: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 18.034345939s May 15 01:12:59.611: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 20.038820699s May 15 01:13:01.614: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 22.041643589s May 15 01:13:03.620: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 24.047811204s May 15 01:13:05.624: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 26.051403033s May 15 01:13:07.628: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 28.055408678s May 15 01:13:09.631: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 30.058159261s May 15 01:13:11.634: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 32.061201391s May 15 01:13:13.638: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 34.065012935s May 15 01:13:15.640: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 36.067650385s May 15 01:13:17.643: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 38.070919214s May 15 01:13:19.646: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 40.073596961s May 15 01:13:21.649: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 42.076953477s May 15 01:13:23.652: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 44.079776079s May 15 01:13:25.655: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 46.082893301s May 15 01:13:27.658: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 48.085925028s May 15 01:13:29.661: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 50.088700946s May 15 01:13:31.665: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 52.092419768s May 15 01:13:33.668: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 54.095271909s May 15 01:13:35.671: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 56.098860706s May 15 01:13:37.675: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 58.102067219s May 15 01:13:39.678: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.105182477s May 15 01:13:41.682: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.109364874s May 15 01:13:43.684: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.111863968s May 15 01:13:45.688: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.115237088s May 15 01:13:47.692: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.119365155s May 15 01:13:49.696: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.123196707s May 15 01:13:51.700: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.127348316s May 15 01:13:53.703: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.130316617s May 15 01:13:55.706: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.133143384s May 15 01:13:57.708: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.135841154s May 15 01:13:59.711: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.138821393s May 15 01:14:01.714: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.141304185s May 15 01:14:03.717: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.14472139s May 15 01:14:05.721: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.148642821s May 15 01:14:07.725: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.152519909s May 15 01:14:09.728: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.15544908s May 15 01:14:11.731: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.15847033s May 15 01:14:13.734: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.161668601s May 15 01:14:15.738: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.165062913s May 15 01:14:17.741: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.168604175s May 15 01:14:19.744: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.171904702s May 15 01:14:21.747: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.174773055s May 15 01:14:23.750: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.177434333s May 15 01:14:25.754: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.181393287s May 15 01:14:27.757: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.184390213s May 15 01:14:29.761: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.188874172s May 15 01:14:31.764: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.191911485s May 15 01:14:33.768: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.194992755s May 15 01:14:35.771: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.198048143s May 15 01:14:37.774: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.201800209s May 15 01:14:39.777: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.204427991s May 15 01:14:41.780: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.207101843s May 15 01:14:43.783: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.210918368s May 15 01:14:45.787: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.214245073s May 15 01:14:47.790: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.217474865s May 15 01:14:49.793: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.219975988s May 15 01:14:51.795: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.222837941s May 15 01:14:53.799: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.226328618s May 15 01:14:55.802: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.229925688s May 15 01:14:57.805: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.232421048s May 15 01:14:59.808: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.235719172s May 15 01:15:01.812: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.239081219s May 15 01:15:03.814: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.241934381s May 15 01:15:05.818: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.245264364s May 15 01:15:07.821: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.248815368s May 15 01:15:09.825: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.252198897s May 15 01:15:11.828: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.255941306s May 15 01:15:13.832: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.259341756s May 15 01:15:15.834: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.261904003s May 15 01:15:17.838: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.265875109s May 15 01:15:19.841: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.268782432s May 15 01:15:21.844: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.271308529s May 15 01:15:23.847: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.274426159s May 15 01:15:25.850: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.277164712s May 15 01:15:27.854: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.281174347s May 15 01:15:29.856: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.283369375s May 15 01:15:31.859: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.286665897s May 15 01:15:33.863: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.29009124s May 15 01:15:35.866: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.293950631s May 15 01:15:37.869: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.296687937s May 15 01:15:39.872: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.299895777s May 15 01:15:41.876: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.303039011s May 15 01:15:43.879: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.306238977s May 15 01:15:45.883: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.31000132s May 15 01:15:47.886: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.313333197s May 15 01:15:49.889: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.316906168s May 15 01:15:51.893: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.320029458s May 15 01:15:53.895: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.322874618s May 15 01:15:55.899: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.326309382s May 15 01:15:57.902: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.329947984s May 15 01:15:59.907: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.334202642s May 15 01:16:01.912: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.339111001s May 15 01:16:03.915: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.342237194s May 15 01:16:05.919: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.34628518s May 15 01:16:07.922: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.349841784s May 15 01:16:09.926: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.352999905s May 15 01:16:11.929: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.356264913s May 15 01:16:13.932: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.359156518s May 15 01:16:15.934: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.361534756s May 15 01:16:17.938: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.36527025s May 15 01:16:19.942: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.369004615s May 15 01:16:21.946: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.373022777s May 15 01:16:23.949: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.376512716s May 15 01:16:25.952: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.37905298s May 15 01:16:27.955: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.382353428s May 15 01:16:29.958: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.385123858s May 15 01:16:31.960: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.387739154s May 15 01:16:33.964: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.391064757s May 15 01:16:35.966: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.393914071s May 15 01:16:37.969: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.396733663s May 15 01:16:39.973: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.39997956s May 15 01:16:41.976: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.403343033s May 15 01:16:43.979: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.406065455s May 15 01:16:45.981: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.408844815s May 15 01:16:47.984: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.411833125s May 15 01:16:49.987: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.414899759s May 15 01:16:51.991: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.418146185s May 15 01:16:53.994: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.421463053s May 15 01:16:55.998: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.425583174s May 15 01:16:58.002: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.429041521s May 15 01:17:00.006: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.433148709s May 15 01:17:02.008: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.435664627s May 15 01:17:04.011: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.438814838s May 15 01:17:06.016: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.443065633s May 15 01:17:08.020: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.447893984s May 15 01:17:10.024: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.451631312s May 15 01:17:12.027: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.454721198s May 15 01:17:14.030: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.457719186s May 15 01:17:16.033: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.460029387s May 15 01:17:18.036: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.463377452s May 15 01:17:20.040: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.467088753s May 15 01:17:22.043: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.470205039s May 15 01:17:24.046: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.473567874s May 15 01:17:26.049: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.47613547s May 15 01:17:28.052: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.479127978s May 15 01:17:30.055: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.482194027s May 15 01:17:32.057: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.484878864s May 15 01:17:34.060: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.487530197s May 15 01:17:36.066: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.493108561s May 15 01:17:38.068: INFO: Pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.495528731s May 15 01:17:40.074: INFO: Failed to get logs from node "node2" pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6" container "test-container": the server rejected our request for an unknown reason (get pods security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6) STEP: delete the pod May 15 01:17:40.079: INFO: Waiting for pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 to disappear May 15 01:17:40.081: INFO: Pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 still exists May 15 01:17:42.081: INFO: Waiting for pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 to disappear May 15 01:17:42.085: INFO: Pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 still exists May 15 01:17:44.081: INFO: Waiting for pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 to disappear May 15 01:17:44.083: INFO: Pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 still exists May 15 01:17:46.082: INFO: Waiting for pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 to disappear May 15 01:17:46.084: INFO: Pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 still exists May 15 01:17:48.081: INFO: Waiting for pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 to disappear May 15 01:17:48.084: INFO: Pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 still exists May 15 01:17:50.081: INFO: Waiting for pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 to disappear May 15 01:17:50.084: INFO: Pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 still exists May 15 01:17:52.082: INFO: Waiting for pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 to disappear May 15 01:17:52.085: INFO: Pod security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 no longer exists May 15 01:17:52.086: FAIL: Unexpected error: <*errors.errorString | 0xc002e1f3a0>: { s: "expected pod \"security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6\" success: Gave up after waiting 5m0s for pod \"security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6\" to be \"Succeeded or Failed\"", } expected pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6" success: Gave up after waiting 5m0s for pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0019dab00, 0x4ca47cd, 0x28, 0xc0020ee000, 0x0, 0xc003daf1c8, 0x1, 0x1, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/node.glob..func14.12() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:178 +0x145 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003c50900) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003c50900) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003c50900, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-4205". STEP: Found 9 events. May 15 01:17:52.090: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6: { } Scheduled: Successfully assigned security-context-4205/security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6 to node2 May 15 01:17:52.090: INFO: At 2021-05-15 01:12:52 +0000 UTC - event for security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6: {multus } AddedInterface: Add eth0 [10.244.4.146/24] May 15 01:17:52.091: INFO: At 2021-05-15 01:12:52 +0000 UTC - event for security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:17:52.091: INFO: At 2021-05-15 01:12:57 +0000 UTC - event for security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:17:52.091: INFO: At 2021-05-15 01:12:57 +0000 UTC - event for security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6: {kubelet node2} Failed: Error: ErrImagePull May 15 01:17:52.091: INFO: At 2021-05-15 01:12:58 +0000 UTC - event for security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 15 01:17:52.091: INFO: At 2021-05-15 01:13:00 +0000 UTC - event for security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6: {multus } AddedInterface: Add eth0 [10.244.4.149/24] May 15 01:17:52.091: INFO: At 2021-05-15 01:13:00 +0000 UTC - event for security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:17:52.091: INFO: At 2021-05-15 01:13:00 +0000 UTC - event for security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6: {kubelet node2} Failed: Error: ImagePullBackOff May 15 01:17:52.093: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:17:52.093: INFO: May 15 01:17:52.098: INFO: Logging node info for node master1 May 15 01:17:52.100: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 143973 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:51 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:52.101: INFO: Logging kubelet events for node master1 May 15 01:17:52.105: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:17:52.127: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:52.127: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:52.127: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:52.127: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.127: INFO: Container kube-scheduler ready: true, restart count 0 May 15 01:17:52.127: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.127: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:52.127: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:52.127: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:52.127: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:52.127: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.127: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:52.127: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.127: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:52.127: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:17:52.127: INFO: Container docker-registry ready: true, restart count 0 May 15 01:17:52.127: INFO: Container nginx ready: true, restart count 0 May 15 01:17:52.127: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.127: INFO: Container nfd-controller ready: true, restart count 0 May 15 01:17:52.127: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.127: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:52.127: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.127: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 W0515 01:17:52.142173 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:52.167: INFO: Latency metrics for node master1 May 15 01:17:52.167: INFO: Logging node info for node master2 May 15 01:17:52.169: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 143899 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:52.170: INFO: Logging kubelet events for node master2 May 15 01:17:52.176: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:17:52.185: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.185: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:52.185: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.185: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:52.185: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.185: INFO: Container coredns ready: true, restart count 0 May 15 01:17:52.185: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.185: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:17:52.185: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.185: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:17:52.185: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.185: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:17:52.185: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:52.185: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:52.185: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:52.185: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.185: INFO: Container autoscaler ready: true, restart count 2 May 15 01:17:52.185: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:52.185: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:52.185: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:52.185: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:17:52.185: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:52.185: INFO: Container prometheus-operator ready: true, restart count 0 W0515 01:17:52.199786 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:52.224: INFO: Latency metrics for node master2 May 15 01:17:52.224: INFO: Logging node info for node master3 May 15 01:17:52.226: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 143830 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:47 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:52.227: INFO: Logging kubelet events for node master3 May 15 01:17:52.232: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:17:52.239: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.239: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:17:52.239: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:52.239: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:52.239: INFO: Container kube-flannel ready: true, restart count 2 May 15 01:17:52.239: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.239: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:52.239: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.239: INFO: Container coredns ready: true, restart count 0 May 15 01:17:52.239: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:52.239: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:52.239: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:52.239: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.239: INFO: Container kube-controller-manager ready: true, restart count 3 May 15 01:17:52.239: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.239: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:17:52.239: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.239: INFO: Container kube-apiserver ready: true, restart count 0 W0515 01:17:52.252694 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:52.279: INFO: Latency metrics for node master3 May 15 01:17:52.279: INFO: Logging node info for node node1 May 15 01:17:52.282: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 144024 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:52 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:52 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:52 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:52 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:52.283: INFO: Logging kubelet events for node node1 May 15 01:17:52.287: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:17:52.299: INFO: security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 started at 2021-05-15 01:13:13 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.299: INFO: Container test-container ready: false, restart count 0 May 15 01:17:52.299: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:17:52.299: INFO: Container collectd ready: true, restart count 0 May 15 01:17:52.299: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:52.299: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:52.299: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:52.299: INFO: Init container install-cni ready: true, restart count 0 May 15 01:17:52.299: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:17:52.299: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.299: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:52.299: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.299: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:52.299: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:17:52.299: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:17:52.299: INFO: Container grafana ready: false, restart count 0 May 15 01:17:52.299: INFO: Container prometheus ready: false, restart count 22 May 15 01:17:52.299: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:17:52.299: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:17:52.299: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:17:52.299: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:52.299: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:52.299: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:17:52.299: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:52.299: INFO: Container reconcile ready: true, restart count 0 May 15 01:17:52.299: INFO: pod-submit-status-1-3 started at (0+0 container statuses recorded) May 15 01:17:52.299: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.299: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:52.299: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.299: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:52.299: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.299: INFO: Container nginx-proxy ready: true, restart count 2 W0515 01:17:52.313813 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:52.345: INFO: Latency metrics for node node1 May 15 01:17:52.345: INFO: Logging node info for node node2 May 15 01:17:52.347: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 143896 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:17:48 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:17:52.348: INFO: Logging kubelet events for node node2 May 15 01:17:52.354: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:17:52.367: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.367: INFO: Container cmk-webhook ready: true, restart count 0 May 15 01:17:52.367: INFO: pod-submit-remove-84d378b0-3001-4971-b893-6beedd97e9fa started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.367: INFO: Container agnhost-container ready: true, restart count 0 May 15 01:17:52.367: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:17:52.367: INFO: Container discover ready: false, restart count 0 May 15 01:17:52.367: INFO: Container init ready: false, restart count 0 May 15 01:17:52.367: INFO: Container install ready: false, restart count 0 May 15 01:17:52.367: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.367: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:17:52.367: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.367: INFO: Container kube-multus ready: true, restart count 1 May 15 01:17:52.367: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.367: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:17:52.367: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.367: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:17:52.367: INFO: master started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.367: INFO: Container cntr ready: false, restart count 0 May 15 01:17:52.367: INFO: pod-submit-status-2-2 started at (0+0 container statuses recorded) May 15 01:17:52.367: INFO: pod-submit-status-0-2 started at (0+0 container statuses recorded) May 15 01:17:52.367: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:17:52.367: INFO: Init container install-cni ready: true, restart count 1 May 15 01:17:52.367: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:17:52.367: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:17:52.367: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:17:52.367: INFO: Container node-exporter ready: true, restart count 0 May 15 01:17:52.367: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:17:52.367: INFO: Container tas-controller ready: true, restart count 0 May 15 01:17:52.367: INFO: Container tas-extender ready: true, restart count 0 May 15 01:17:52.367: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:17:52.367: INFO: Container collectd ready: true, restart count 0 May 15 01:17:52.367: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:17:52.367: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:17:52.367: INFO: pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321 started at 2021-05-15 01:17:47 +0000 UTC (1+1 container statuses recorded) May 15 01:17:52.367: INFO: Init container foo ready: false, restart count 0 May 15 01:17:52.367: INFO: Container bar ready: false, restart count 0 May 15 01:17:52.367: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.367: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:17:52.367: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:17:52.367: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:17:52.367: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:17:52.367: INFO: Container nodereport ready: true, restart count 0 May 15 01:17:52.367: INFO: Container reconcile ready: true, restart count 0 W0515 01:17:52.378027 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:17:53.174: INFO: Latency metrics for node node2 May 15 01:17:53.174: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-4205" for this suite. • Failure [313.647 seconds] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support seccomp default which is unconfined [Feature:Seccomp] [LinuxOnly] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:174 May 15 01:17:52.086: Unexpected error: <*errors.errorString | 0xc002e1f3a0>: { s: "expected pod \"security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6\" success: Gave up after waiting 5m0s for pod \"security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6\" to be \"Succeeded or Failed\"", } expected pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6" success: Gave up after waiting 5m0s for pod "security-context-f4fdc3eb-51e5-4c2e-a07c-052c72ba70d6" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] Security Context should support seccomp default which is unconfined [Feature:Seccomp] [LinuxOnly]","total":-1,"completed":0,"skipped":281,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support seccomp default which is unconfined [Feature:Seccomp] [LinuxOnly]"]} May 15 01:17:53.188: INFO: Running AfterSuite actions on all nodes [BeforeEach] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:17:44.756: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Delete Grace Period /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:53 [It] should be submitted and removed /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:62 STEP: creating the pod STEP: setting up selector STEP: submitting the pod to kubernetes STEP: verifying the pod is in kubernetes STEP: deleting the pod gracefully STEP: verifying the kubelet observed the termination notice May 15 01:17:55.831: INFO: start=2021-05-15 01:17:50.812073626 +0000 UTC m=+313.590871083, now=2021-05-15 01:17:55.831052608 +0000 UTC m=+318.609850069, kubelet pod: {"metadata":{"name":"pod-submit-remove-84d378b0-3001-4971-b893-6beedd97e9fa","namespace":"pods-6444","selfLink":"/api/v1/namespaces/pods-6444/pods/pod-submit-remove-84d378b0-3001-4971-b893-6beedd97e9fa","uid":"0be443fd-0c8a-4aab-b9cb-9f39d5f45fb7","resourceVersion":"143792","creationTimestamp":"2021-05-15T01:17:44Z","deletionTimestamp":"2021-05-15T01:18:20Z","deletionGracePeriodSeconds":30,"labels":{"name":"foo","time":"777242366"},"annotations":{"k8s.v1.cni.cncf.io/network-status":"[{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.151\"\n ],\n \"mac\": \"96:3d:fa:7a:50:f2\",\n \"default\": true,\n \"dns\": {}\n}]","k8s.v1.cni.cncf.io/networks-status":"[{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.151\"\n ],\n \"mac\": \"96:3d:fa:7a:50:f2\",\n \"default\": true,\n \"dns\": {}\n}]","kubernetes.io/config.seen":"2021-05-15T01:17:44.802580534Z","kubernetes.io/config.source":"api","kubernetes.io/psp":"collectd"},"managedFields":[{"manager":"e2e.test","operation":"Update","apiVersion":"v1","time":"2021-05-15T01:17:44Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:time":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"agnhost-container\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}]},"spec":{"volumes":[{"name":"default-token-b89dp","secret":{"secretName":"default-token-b89dp","defaultMode":420}}],"containers":[{"name":"agnhost-container","image":"k8s.gcr.io/e2e-test-images/agnhost:2.20","args":["pause"],"resources":{},"volumeMounts":[{"name":"default-token-b89dp","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{}}],"restartPolicy":"Always","terminationGracePeriodSeconds":0,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"node2","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true,"preemptionPolicy":"PreemptLowerPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2021-05-15T01:17:44Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2021-05-15T01:17:49Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2021-05-15T01:17:49Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2021-05-15T01:17:44Z"}],"hostIP":"10.10.190.208","podIP":"10.244.4.151","podIPs":[{"ip":"10.244.4.151"}],"startTime":"2021-05-15T01:17:44Z","containerStatuses":[{"name":"agnhost-container","state":{"running":{"startedAt":"2021-05-15T01:17:49Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/e2e-test-images/agnhost:2.20","imageID":"docker-pullable://k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0","containerID":"docker://36430eb67133e30cfe95a0f9884bc7283bd48c42d06ee642c92829fb5093f2db","started":true}],"qosClass":"BestEffort"}} May 15 01:18:01.038: INFO: no pod exists with the name we were looking for, assuming the termination request was observed and completed [AfterEach] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 May 15 01:18:01.041: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-6444" for this suite. • [SLOW TEST:16.293 seconds] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 [k8s.io] Delete Grace Period /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should be submitted and removed /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:62 ------------------------------ {"msg":"PASSED [k8s.io] [sig-node] Pods Extended [k8s.io] Delete Grace Period should be submitted and removed","total":-1,"completed":1,"skipped":442,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support pod.Spec.SecurityContext.RunAsUser [LinuxOnly]"]} May 15 01:18:01.051: INFO: Running AfterSuite actions on all nodes [BeforeEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:13:13.924: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context STEP: Waiting for a default service account to be provisioned in namespace [It] should support seccomp alpha unconfined annotation on the container [Feature:Seccomp] [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:149 STEP: Creating a pod to test seccomp.security.alpha.kubernetes.io/pod May 15 01:13:13.960: INFO: Waiting up to 5m0s for pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7" in namespace "security-context-619" to be "Succeeded or Failed" May 15 01:13:13.964: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3.826428ms May 15 01:13:15.967: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.00751642s May 15 01:13:17.971: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.010894241s May 15 01:13:19.975: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.015603533s May 15 01:13:21.981: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.02084234s May 15 01:13:23.985: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 10.024910698s May 15 01:13:25.989: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 12.029581976s May 15 01:13:27.993: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 14.033091316s May 15 01:13:29.998: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 16.037915171s May 15 01:13:32.002: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 18.042404298s May 15 01:13:34.006: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 20.046541487s May 15 01:13:36.011: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 22.051297187s May 15 01:13:38.016: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 24.056473686s May 15 01:13:40.020: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 26.060568113s May 15 01:13:42.025: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 28.065095812s May 15 01:13:44.029: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 30.068860119s May 15 01:13:46.034: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 32.074120172s May 15 01:13:48.038: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 34.0779379s May 15 01:13:50.042: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 36.082662846s May 15 01:13:52.048: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 38.088540219s May 15 01:13:54.052: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 40.091859005s May 15 01:13:56.056: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 42.096086201s May 15 01:13:58.062: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 44.101758677s May 15 01:14:00.067: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 46.106902909s May 15 01:14:02.070: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 48.110391946s May 15 01:14:04.075: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 50.115305039s May 15 01:14:06.080: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 52.120101647s May 15 01:14:08.084: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 54.124522023s May 15 01:14:10.088: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 56.1286137s May 15 01:14:12.092: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 58.132176239s May 15 01:14:14.096: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.136027721s May 15 01:14:16.099: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.139012732s May 15 01:14:18.103: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.143305156s May 15 01:14:20.108: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.147938223s May 15 01:14:22.111: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.151548741s May 15 01:14:24.114: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.154607646s May 15 01:14:26.118: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.158444496s May 15 01:14:28.122: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.161997332s May 15 01:14:30.127: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.166686688s May 15 01:14:32.131: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.170949925s May 15 01:14:34.135: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.175371498s May 15 01:14:36.138: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.178518555s May 15 01:14:38.143: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.183380594s May 15 01:14:40.147: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.18710405s May 15 01:14:42.150: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.189685324s May 15 01:14:44.153: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.193676428s May 15 01:14:46.157: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.196872217s May 15 01:14:48.160: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.200488121s May 15 01:14:50.165: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.205090932s May 15 01:14:52.174: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.214037726s May 15 01:14:54.179: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.218759759s May 15 01:14:56.183: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.223513863s May 15 01:14:58.186: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.226619827s May 15 01:15:00.190: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.230449349s May 15 01:15:02.195: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.23495651s May 15 01:15:04.199: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.239387664s May 15 01:15:06.203: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.243626025s May 15 01:15:08.207: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.24681758s May 15 01:15:10.210: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.250351683s May 15 01:15:12.214: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.253950172s May 15 01:15:14.217: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.257358475s May 15 01:15:16.222: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.262588465s May 15 01:15:18.226: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.266485349s May 15 01:15:20.230: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.270000794s May 15 01:15:22.233: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.27328881s May 15 01:15:24.236: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.276642083s May 15 01:15:26.241: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.281107192s May 15 01:15:28.246: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.286061553s May 15 01:15:30.250: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.290021712s May 15 01:15:32.253: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.293147273s May 15 01:15:34.256: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.296186745s May 15 01:15:36.261: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.301163715s May 15 01:15:38.264: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.304600195s May 15 01:15:40.268: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.308580055s May 15 01:15:42.272: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.312180772s May 15 01:15:44.275: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.314976059s May 15 01:15:46.280: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.319771971s May 15 01:15:48.285: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.324832538s May 15 01:15:50.290: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.329922693s May 15 01:15:52.293: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.333485355s May 15 01:15:54.297: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.337061908s May 15 01:15:56.302: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.342384253s May 15 01:15:58.307: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.346970163s May 15 01:16:00.311: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.351664469s May 15 01:16:02.315: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.354777347s May 15 01:16:04.319: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.358735615s May 15 01:16:06.322: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.362529851s May 15 01:16:08.326: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.366585007s May 15 01:16:10.330: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.370200191s May 15 01:16:12.333: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.372824924s May 15 01:16:14.336: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.37609454s May 15 01:16:16.339: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.379019833s May 15 01:16:18.342: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.381811273s May 15 01:16:20.345: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.384982919s May 15 01:16:22.349: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.388763809s May 15 01:16:24.352: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.391907101s May 15 01:16:26.354: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.394551314s May 15 01:16:28.357: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.397533725s May 15 01:16:30.360: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.400665796s May 15 01:16:32.364: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.404076944s May 15 01:16:34.367: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.407027606s May 15 01:16:36.370: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.41062055s May 15 01:16:38.374: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.414667931s May 15 01:16:40.379: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.41872035s May 15 01:16:42.384: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.423768837s May 15 01:16:44.387: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.42749643s May 15 01:16:46.391: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.431143513s May 15 01:16:48.394: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.434010285s May 15 01:16:50.400: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.439687529s May 15 01:16:52.403: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.443157692s May 15 01:16:54.406: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.446180873s May 15 01:16:56.409: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.449259103s May 15 01:16:58.415: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.455493123s May 15 01:17:00.421: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.460767208s May 15 01:17:02.425: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.464885166s May 15 01:17:04.429: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.469622321s May 15 01:17:06.434: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.474560499s May 15 01:17:08.439: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.479364354s May 15 01:17:10.444: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.484482116s May 15 01:17:12.448: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.487701288s May 15 01:17:14.453: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.492856974s May 15 01:17:16.457: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.497446876s May 15 01:17:18.462: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.502066474s May 15 01:17:20.467: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.506979964s May 15 01:17:22.471: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.511029748s May 15 01:17:24.475: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.515310638s May 15 01:17:26.481: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.520761023s May 15 01:17:28.485: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.525261336s May 15 01:17:30.491: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.530989244s May 15 01:17:32.494: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.534625858s May 15 01:17:34.498: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.538586701s May 15 01:17:36.506: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.546627493s May 15 01:17:38.511: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.551545682s May 15 01:17:40.516: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.556548321s May 15 01:17:42.520: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.560114505s May 15 01:17:44.523: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.56278192s May 15 01:17:46.525: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.565452643s May 15 01:17:48.529: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.569604489s May 15 01:17:50.534: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.574495723s May 15 01:17:52.537: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.577650276s May 15 01:17:54.542: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.582197842s May 15 01:17:56.547: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.58753263s May 15 01:17:58.550: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.590374019s May 15 01:18:00.554: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.593893617s May 15 01:18:02.556: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.596509121s May 15 01:18:04.560: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.599925256s May 15 01:18:06.565: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.604745026s May 15 01:18:08.568: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.607794807s May 15 01:18:10.572: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.611713934s May 15 01:18:12.574: INFO: Pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.614303123s May 15 01:18:14.862: INFO: Failed to get logs from node "node1" pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7" container "test-container": the server rejected our request for an unknown reason (get pods security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7) STEP: delete the pod May 15 01:18:14.867: INFO: Waiting for pod security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 to disappear May 15 01:18:14.870: INFO: Pod security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 still exists May 15 01:18:16.874: INFO: Waiting for pod security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 to disappear May 15 01:18:16.878: INFO: Pod security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 still exists May 15 01:18:18.870: INFO: Waiting for pod security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 to disappear May 15 01:18:18.873: INFO: Pod security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 no longer exists May 15 01:18:18.873: FAIL: Unexpected error: <*errors.errorString | 0xc0047a3170>: { s: "expected pod \"security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7\" success: Gave up after waiting 5m0s for pod \"security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7\" to be \"Succeeded or Failed\"", } expected pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7" success: Gave up after waiting 5m0s for pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc001b4a580, 0x4ca47cd, 0x28, 0xc004626000, 0x0, 0xc0020831c8, 0x1, 0x1, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/node.glob..func14.9() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:155 +0x1f5 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00188f080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00188f080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00188f080, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-619". STEP: Found 8 events. May 15 01:18:18.877: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7: { } Scheduled: Successfully assigned security-context-619/security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7 to node1 May 15 01:18:18.877: INFO: At 2021-05-15 01:13:16 +0000 UTC - event for security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7: {multus } AddedInterface: Add eth0 [10.244.3.62/24] May 15 01:18:18.877: INFO: At 2021-05-15 01:13:16 +0000 UTC - event for security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:18:18.877: INFO: At 2021-05-15 01:13:17 +0000 UTC - event for security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:18:18.877: INFO: At 2021-05-15 01:13:17 +0000 UTC - event for security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7: {kubelet node1} Failed: Error: ErrImagePull May 15 01:18:18.877: INFO: At 2021-05-15 01:13:17 +0000 UTC - event for security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:18:18.877: INFO: At 2021-05-15 01:13:17 +0000 UTC - event for security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7: {kubelet node1} Failed: Error: ImagePullBackOff May 15 01:18:18.877: INFO: At 2021-05-15 01:13:58 +0000 UTC - event for security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:18:18.879: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:18:18.879: INFO: May 15 01:18:18.883: INFO: Logging node info for node master1 May 15 01:18:18.885: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 144360 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:11 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:11 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:11 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:18:11 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:18:18.885: INFO: Logging kubelet events for node master1 May 15 01:18:18.889: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:18:18.898: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.898: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:18:18.898: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:18:18.898: INFO: Init container install-cni ready: true, restart count 0 May 15 01:18:18.898: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:18:18.898: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:18:18.898: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:18:18.898: INFO: Container node-exporter ready: true, restart count 0 May 15 01:18:18.898: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.898: INFO: Container kube-scheduler ready: true, restart count 0 May 15 01:18:18.898: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:18:18.898: INFO: Container docker-registry ready: true, restart count 0 May 15 01:18:18.898: INFO: Container nginx ready: true, restart count 0 May 15 01:18:18.898: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.898: INFO: Container nfd-controller ready: true, restart count 0 May 15 01:18:18.898: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.898: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:18:18.898: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.898: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:18:18.898: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.898: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:18:18.898: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.898: INFO: Container kube-multus ready: true, restart count 1 W0515 01:18:18.911875 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:18:18.939: INFO: Latency metrics for node master1 May 15 01:18:18.939: INFO: Logging node info for node master2 May 15 01:18:18.941: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 144328 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:09 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:09 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:09 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:18:09 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:18:18.942: INFO: Logging kubelet events for node master2 May 15 01:18:18.947: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:18:18.956: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.956: INFO: Container coredns ready: true, restart count 0 May 15 01:18:18.956: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.956: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:18:18.956: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.956: INFO: Container kube-multus ready: true, restart count 1 May 15 01:18:18.956: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.956: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:18:18.956: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:18:18.956: INFO: Init container install-cni ready: true, restart count 0 May 15 01:18:18.956: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:18:18.956: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.956: INFO: Container autoscaler ready: true, restart count 2 May 15 01:18:18.956: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:18:18.956: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:18:18.956: INFO: Container node-exporter ready: true, restart count 0 May 15 01:18:18.956: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:18:18.956: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:18:18.956: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:18:18.956: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.956: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:18:18.956: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:18:18.956: INFO: Container kube-controller-manager ready: true, restart count 2 W0515 01:18:18.969726 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:18:18.996: INFO: Latency metrics for node master2 May 15 01:18:18.996: INFO: Logging node info for node master3 May 15 01:18:19.000: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 144444 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:17 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:17 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:17 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:18:17 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:18:19.000: INFO: Logging kubelet events for node master3 May 15 01:18:19.005: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:18:19.013: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.013: INFO: Container kube-multus ready: true, restart count 1 May 15 01:18:19.013: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.013: INFO: Container coredns ready: true, restart count 0 May 15 01:18:19.013: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:18:19.013: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:18:19.013: INFO: Container node-exporter ready: true, restart count 0 May 15 01:18:19.013: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.013: INFO: Container kube-controller-manager ready: true, restart count 3 May 15 01:18:19.013: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.013: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:18:19.013: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.013: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:18:19.013: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.013: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:18:19.013: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:18:19.013: INFO: Init container install-cni ready: true, restart count 0 May 15 01:18:19.013: INFO: Container kube-flannel ready: true, restart count 2 W0515 01:18:19.024709 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:18:19.055: INFO: Latency metrics for node master3 May 15 01:18:19.055: INFO: Logging node info for node node1 May 15 01:18:19.058: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 144373 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:12 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:12 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:12 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:18:12 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:18:19.058: INFO: Logging kubelet events for node node1 May 15 01:18:19.064: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:18:19.076: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:18:19.076: INFO: Init container install-cni ready: true, restart count 0 May 15 01:18:19.076: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:18:19.076: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.076: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:18:19.076: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:18:19.076: INFO: Container collectd ready: true, restart count 0 May 15 01:18:19.076: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:18:19.076: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:18:19.076: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.076: INFO: Container kube-multus ready: true, restart count 1 May 15 01:18:19.076: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:18:19.076: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:18:19.076: INFO: Container grafana ready: false, restart count 0 May 15 01:18:19.076: INFO: Container prometheus ready: false, restart count 22 May 15 01:18:19.076: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:18:19.076: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:18:19.076: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:18:19.076: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:18:19.076: INFO: Container node-exporter ready: true, restart count 0 May 15 01:18:19.076: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:18:19.076: INFO: Container nodereport ready: true, restart count 0 May 15 01:18:19.076: INFO: Container reconcile ready: true, restart count 0 May 15 01:18:19.076: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.076: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:18:19.076: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.076: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:18:19.076: INFO: pod-submit-status-0-7 started at (0+0 container statuses recorded) May 15 01:18:19.076: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.076: INFO: Container nginx-proxy ready: true, restart count 2 W0515 01:18:19.088731 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:18:19.236: INFO: Latency metrics for node node1 May 15 01:18:19.236: INFO: Logging node info for node node2 May 15 01:18:19.238: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 144333 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:09 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:09 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:18:09 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:18:09 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:18:19.239: INFO: Logging kubelet events for node node2 May 15 01:18:19.244: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:18:19.256: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.256: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:18:19.256: INFO: master started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.256: INFO: Container cntr ready: false, restart count 0 May 15 01:18:19.256: INFO: pod-submit-status-2-10 started at 2021-05-15 01:18:16 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.256: INFO: Container busybox ready: false, restart count 0 May 15 01:18:19.256: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:18:19.256: INFO: Init container install-cni ready: true, restart count 1 May 15 01:18:19.256: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:18:19.256: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:18:19.256: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:18:19.256: INFO: Container node-exporter ready: true, restart count 0 May 15 01:18:19.256: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:18:19.256: INFO: Container tas-controller ready: true, restart count 0 May 15 01:18:19.256: INFO: Container tas-extender ready: true, restart count 0 May 15 01:18:19.256: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:18:19.256: INFO: Container collectd ready: true, restart count 0 May 15 01:18:19.256: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:18:19.256: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:18:19.256: INFO: pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321 started at 2021-05-15 01:17:47 +0000 UTC (1+1 container statuses recorded) May 15 01:18:19.256: INFO: Init container foo ready: false, restart count 0 May 15 01:18:19.256: INFO: Container bar ready: false, restart count 0 May 15 01:18:19.256: INFO: pod-submit-status-1-10 started at 2021-05-15 01:18:18 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.256: INFO: Container busybox ready: false, restart count 0 May 15 01:18:19.256: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.256: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:18:19.256: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.256: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:18:19.256: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:18:19.256: INFO: Container nodereport ready: true, restart count 0 May 15 01:18:19.256: INFO: Container reconcile ready: true, restart count 0 May 15 01:18:19.256: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.256: INFO: Container cmk-webhook ready: true, restart count 0 May 15 01:18:19.256: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:18:19.256: INFO: Container discover ready: false, restart count 0 May 15 01:18:19.256: INFO: Container init ready: false, restart count 0 May 15 01:18:19.256: INFO: Container install ready: false, restart count 0 May 15 01:18:19.256: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.256: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:18:19.256: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.256: INFO: Container kube-multus ready: true, restart count 1 May 15 01:18:19.256: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:18:19.256: INFO: Container kubernetes-dashboard ready: true, restart count 2 W0515 01:18:19.269218 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:18:19.301: INFO: Latency metrics for node node2 May 15 01:18:19.301: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-619" for this suite. • Failure [305.384 seconds] [k8s.io] [sig-node] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support seccomp alpha unconfined annotation on the container [Feature:Seccomp] [LinuxOnly] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:149 May 15 01:18:18.873: Unexpected error: <*errors.errorString | 0xc0047a3170>: { s: "expected pod \"security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7\" success: Gave up after waiting 5m0s for pod \"security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7\" to be \"Succeeded or Failed\"", } expected pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7" success: Gave up after waiting 5m0s for pod "security-context-414f516c-004c-48f5-a595-dfdfd84d6ba7" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] Security Context should support seccomp alpha unconfined annotation on the container [Feature:Seccomp] [LinuxOnly]","total":-1,"completed":1,"skipped":481,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support seccomp alpha unconfined annotation on the container [Feature:Seccomp] [LinuxOnly]"]} May 15 01:18:19.315: INFO: Running AfterSuite actions on all nodes [BeforeEach] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:17:44.978: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pod Container Status /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:204 [It] should never report success for a pending container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:208 STEP: creating pods that should always exit 1 and terminating the pod after a random delay May 15 01:17:47.764: INFO: watch delete seen for pod-submit-status-1-0 May 15 01:17:47.764: INFO: Pod pod-submit-status-1-0 on node node2 timings total=2.766453293s t=1.831s run=0s execute=0s May 15 01:17:47.957: INFO: watch delete seen for pod-submit-status-2-0 May 15 01:17:47.958: INFO: Pod pod-submit-status-2-0 on node node1 timings total=2.960170111s t=1.117s run=0s execute=0s May 15 01:17:50.603: INFO: watch delete seen for pod-submit-status-0-0 May 15 01:17:50.603: INFO: Pod pod-submit-status-0-0 on node node1 timings total=5.605206274s t=1.959s run=0s execute=0s May 15 01:17:51.033: INFO: watch delete seen for pod-submit-status-1-1 May 15 01:17:51.033: INFO: Pod pod-submit-status-1-1 on node node2 timings total=3.268986341s t=257ms run=0s execute=0s May 15 01:17:51.434: INFO: watch delete seen for pod-submit-status-2-1 May 15 01:17:51.434: INFO: Pod pod-submit-status-2-1 on node node2 timings total=3.476675391s t=334ms run=0s execute=0s May 15 01:17:51.801: INFO: watch delete seen for pod-submit-status-0-1 May 15 01:17:51.801: INFO: Pod pod-submit-status-0-1 on node node1 timings total=1.198465329s t=423ms run=0s execute=0s May 15 01:17:52.233: INFO: watch delete seen for pod-submit-status-1-2 May 15 01:17:52.233: INFO: Pod pod-submit-status-1-2 on node node2 timings total=1.200031692s t=177ms run=0s execute=0s May 15 01:17:54.434: INFO: watch delete seen for pod-submit-status-2-2 May 15 01:17:54.434: INFO: Pod pod-submit-status-2-2 on node node2 timings total=2.999299032s t=1.362s run=0s execute=0s May 15 01:17:56.233: INFO: watch delete seen for pod-submit-status-0-2 May 15 01:17:56.233: INFO: Pod pod-submit-status-0-2 on node node2 timings total=4.432249825s t=1.8s run=0s execute=0s May 15 01:17:57.001: INFO: watch delete seen for pod-submit-status-1-3 May 15 01:17:57.001: INFO: Pod pod-submit-status-1-3 on node node1 timings total=4.767494411s t=1.719s run=0s execute=0s May 15 01:17:57.033: INFO: watch delete seen for pod-submit-status-2-3 May 15 01:17:57.034: INFO: Pod pod-submit-status-2-3 on node node2 timings total=2.599871199s t=780ms run=0s execute=0s May 15 01:17:57.830: INFO: watch delete seen for pod-submit-status-0-3 May 15 01:17:57.830: INFO: Pod pod-submit-status-0-3 on node node1 timings total=1.59621012s t=454ms run=0s execute=0s May 15 01:17:59.968: INFO: watch delete seen for pod-submit-status-1-4 May 15 01:17:59.968: INFO: Pod pod-submit-status-1-4 on node node1 timings total=2.967203772s t=1.154s run=0s execute=0s May 15 01:18:00.435: INFO: watch delete seen for pod-submit-status-2-4 May 15 01:18:00.435: INFO: Pod pod-submit-status-2-4 on node node2 timings total=3.401283656s t=1.046s run=0s execute=0s May 15 01:18:02.032: INFO: watch delete seen for pod-submit-status-1-5 May 15 01:18:02.032: INFO: Pod pod-submit-status-1-5 on node node1 timings total=2.0643084s t=1.228s run=0s execute=0s May 15 01:18:04.034: INFO: watch delete seen for pod-submit-status-2-5 May 15 01:18:04.034: INFO: Pod pod-submit-status-2-5 on node node2 timings total=3.59915314s t=476ms run=0s execute=0s May 15 01:18:06.472: INFO: watch delete seen for pod-submit-status-1-6 May 15 01:18:06.472: INFO: Pod pod-submit-status-1-6 on node node2 timings total=4.439741465s t=1.611s run=0s execute=0s May 15 01:18:07.803: INFO: watch delete seen for pod-submit-status-2-6 May 15 01:18:07.803: INFO: Pod pod-submit-status-2-6 on node node2 timings total=3.76908521s t=1.814s run=0s execute=0s May 15 01:18:09.633: INFO: watch delete seen for pod-submit-status-1-7 May 15 01:18:09.633: INFO: Pod pod-submit-status-1-7 on node node2 timings total=3.161004893s t=54ms run=0s execute=0s May 15 01:18:10.033: INFO: watch delete seen for pod-submit-status-0-4 May 15 01:18:10.033: INFO: Pod pod-submit-status-0-4 on node node2 timings total=12.203464597s t=812ms run=0s execute=0s May 15 01:18:10.633: INFO: watch delete seen for pod-submit-status-2-7 May 15 01:18:10.634: INFO: Pod pod-submit-status-2-7 on node node2 timings total=2.830255781s t=596ms run=0s execute=0s May 15 01:18:13.670: INFO: watch delete seen for pod-submit-status-1-8 May 15 01:18:13.671: INFO: Pod pod-submit-status-1-8 on node node1 timings total=4.037289762s t=98ms run=0s execute=0s May 15 01:18:14.054: INFO: watch delete seen for pod-submit-status-2-8 May 15 01:18:14.054: INFO: Pod pod-submit-status-2-8 on node node1 timings total=3.420260523s t=712ms run=0s execute=0s May 15 01:18:14.067: INFO: watch delete seen for pod-submit-status-0-5 May 15 01:18:14.067: INFO: Pod pod-submit-status-0-5 on node node1 timings total=4.033786583s t=1.618s run=0s execute=0s May 15 01:18:16.266: INFO: watch delete seen for pod-submit-status-2-9 May 15 01:18:16.266: INFO: Pod pod-submit-status-2-9 on node node1 timings total=2.212212079s t=547ms run=0s execute=0s May 15 01:18:17.866: INFO: watch delete seen for pod-submit-status-0-6 May 15 01:18:17.866: INFO: Pod pod-submit-status-0-6 on node node1 timings total=3.798754199s t=750ms run=0s execute=0s May 15 01:18:18.267: INFO: watch delete seen for pod-submit-status-1-9 May 15 01:18:18.267: INFO: Pod pod-submit-status-1-9 on node node1 timings total=4.596442869s t=1.147s run=0s execute=0s May 15 01:18:22.265: INFO: watch delete seen for pod-submit-status-1-10 May 15 01:18:22.265: INFO: Pod pod-submit-status-1-10 on node node2 timings total=3.997598539s t=1.475s run=0s execute=0s May 15 01:18:22.484: INFO: watch delete seen for pod-submit-status-0-7 May 15 01:18:22.484: INFO: Pod pod-submit-status-0-7 on node node1 timings total=4.618161475s t=992ms run=0s execute=0s May 15 01:18:26.385: INFO: watch delete seen for pod-submit-status-0-8 May 15 01:18:26.385: INFO: Pod pod-submit-status-0-8 on node node2 timings total=3.900896967s t=905ms run=0s execute=0s May 15 01:18:26.553: INFO: watch delete seen for pod-submit-status-1-11 May 15 01:18:26.553: INFO: Pod pod-submit-status-1-11 on node node1 timings total=4.288431817s t=1.716s run=0s execute=0s May 15 01:18:27.960: INFO: watch delete seen for pod-submit-status-0-9 May 15 01:18:27.960: INFO: Pod pod-submit-status-0-9 on node node2 timings total=1.575011401s t=421ms run=0s execute=0s May 15 01:18:29.052: INFO: watch delete seen for pod-submit-status-1-12 May 15 01:18:29.052: INFO: Pod pod-submit-status-1-12 on node node1 timings total=2.498672839s t=350ms run=0s execute=0s May 15 01:18:29.550: INFO: watch delete seen for pod-submit-status-2-10 May 15 01:18:29.550: INFO: Pod pod-submit-status-2-10 on node node2 timings total=13.283752056s t=1.203s run=0s execute=0s May 15 01:18:32.490: INFO: watch delete seen for pod-submit-status-1-13 May 15 01:18:32.490: INFO: Pod pod-submit-status-1-13 on node node2 timings total=3.43782315s t=1.74s run=0s execute=0s May 15 01:18:36.546: INFO: watch delete seen for pod-submit-status-1-14 May 15 01:18:36.546: INFO: Pod pod-submit-status-1-14 on node node2 timings total=4.055875295s t=1.122s run=0s execute=0s May 15 01:18:39.568: INFO: watch delete seen for pod-submit-status-0-10 May 15 01:18:39.568: INFO: Pod pod-submit-status-0-10 on node node1 timings total=11.607672654s t=1.543s run=0s execute=0s May 15 01:18:39.578: INFO: watch delete seen for pod-submit-status-2-11 May 15 01:18:39.578: INFO: Pod pod-submit-status-2-11 on node node1 timings total=10.027820641s t=1.273s run=0s execute=0s May 15 01:18:42.482: INFO: watch delete seen for pod-submit-status-2-12 May 15 01:18:42.482: INFO: Pod pod-submit-status-2-12 on node node1 timings total=2.904523405s t=768ms run=0s execute=0s May 15 01:18:43.343: INFO: watch delete seen for pod-submit-status-0-11 May 15 01:18:43.343: INFO: Pod pod-submit-status-0-11 on node node2 timings total=3.775484144s t=599ms run=0s execute=0s May 15 01:18:49.551: INFO: watch delete seen for pod-submit-status-2-13 May 15 01:18:49.551: INFO: Pod pod-submit-status-2-13 on node node2 timings total=7.068308002s t=91ms run=0s execute=0s May 15 01:18:49.562: INFO: watch delete seen for pod-submit-status-0-12 May 15 01:18:49.562: INFO: Pod pod-submit-status-0-12 on node node2 timings total=6.218452857s t=1.996s run=0s execute=0s May 15 01:18:59.565: INFO: watch delete seen for pod-submit-status-2-14 May 15 01:18:59.566: INFO: Pod pod-submit-status-2-14 on node node1 timings total=10.014688025s t=1.393s run=0s execute=0s May 15 01:18:59.575: INFO: watch delete seen for pod-submit-status-0-13 May 15 01:18:59.575: INFO: Pod pod-submit-status-0-13 on node node1 timings total=10.012608511s t=116ms run=0s execute=0s May 15 01:19:02.499: INFO: watch delete seen for pod-submit-status-0-14 May 15 01:19:02.499: INFO: Pod pod-submit-status-0-14 on node node1 timings total=2.924052345s t=1.394s run=0s execute=0s [AfterEach] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 May 15 01:19:02.499: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-9948" for this suite. • [SLOW TEST:77.529 seconds] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 [k8s.io] Pod Container Status /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should never report success for a pending container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:208 ------------------------------ {"msg":"PASSED [k8s.io] [sig-node] Pods Extended [k8s.io] Pod Container Status should never report success for a pending container","total":-1,"completed":1,"skipped":528,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support seccomp alpha unconfined annotation on the pod [Feature:Seccomp] [LinuxOnly]"]} May 15 01:19:02.509: INFO: Running AfterSuite actions on all nodes [BeforeEach] [k8s.io] [sig-node] Mount propagation /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:17:44.329: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename mount-propagation STEP: Waiting for a default service account to be provisioned in namespace [It] should propagate mounts to the host /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/mount_propagation.go:82 May 15 01:22:44.380: FAIL: Unexpected error: <*errors.errorString | 0xc0002ba200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc003c10600, 0xc004c9d400, 0xc002b3f4d0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/node.glob..func6.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/mount_propagation.go:113 +0x2c5 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001a02a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001a02a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001a02a80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 May 15 01:22:46.402: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -rf "/var/lib/kubelet/mount-propagation-3211"] Namespace:mount-propagation-3211 PodName:hostexec-node2-7nmkk ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true} May 15 01:22:46.402: INFO: >>> kubeConfig: /root/.kube/config STEP: Deleting pod hostexec-node2-7nmkk in namespace mount-propagation-3211 [AfterEach] [k8s.io] [sig-node] Mount propagation /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "mount-propagation-3211". STEP: Found 12 events. May 15 01:22:46.537: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for hostexec-node2-7nmkk: { } Scheduled: Successfully assigned mount-propagation-3211/hostexec-node2-7nmkk to node2 May 15 01:22:46.537: INFO: At 2021-05-15 01:17:46 +0000 UTC - event for master: {multus } AddedInterface: Add eth0 [10.244.4.150/24] May 15 01:22:46.537: INFO: At 2021-05-15 01:17:46 +0000 UTC - event for master: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:22:46.537: INFO: At 2021-05-15 01:17:47 +0000 UTC - event for master: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:22:46.537: INFO: At 2021-05-15 01:17:47 +0000 UTC - event for master: {kubelet node2} Failed: Error: ErrImagePull May 15 01:22:46.537: INFO: At 2021-05-15 01:17:48 +0000 UTC - event for master: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:22:46.537: INFO: At 2021-05-15 01:17:48 +0000 UTC - event for master: {kubelet node2} Failed: Error: ImagePullBackOff May 15 01:22:46.537: INFO: At 2021-05-15 01:18:02 +0000 UTC - event for master: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:22:46.537: INFO: At 2021-05-15 01:22:44 +0000 UTC - event for hostexec-node2-7nmkk: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 15 01:22:46.537: INFO: At 2021-05-15 01:22:45 +0000 UTC - event for hostexec-node2-7nmkk: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 493.306195ms May 15 01:22:46.537: INFO: At 2021-05-15 01:22:45 +0000 UTC - event for hostexec-node2-7nmkk: {kubelet node2} Created: Created container agnhost-container May 15 01:22:46.537: INFO: At 2021-05-15 01:22:45 +0000 UTC - event for hostexec-node2-7nmkk: {kubelet node2} Started: Started container agnhost-container May 15 01:22:46.539: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:22:46.539: INFO: master node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-15 01:17:44 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-15 01:17:44 +0000 UTC ContainersNotReady containers with unready status: [cntr]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-15 01:17:44 +0000 UTC ContainersNotReady containers with unready status: [cntr]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-15 01:17:44 +0000 UTC }] May 15 01:22:46.539: INFO: May 15 01:22:46.544: INFO: Logging node info for node master1 May 15 01:22:46.546: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 145903 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:42 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:42 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:42 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:22:42 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:22:46.547: INFO: Logging kubelet events for node master1 May 15 01:22:46.551: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:22:46.566: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.566: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:22:46.566: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:22:46.566: INFO: Init container install-cni ready: true, restart count 0 May 15 01:22:46.566: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:22:46.566: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:22:46.566: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:46.566: INFO: Container node-exporter ready: true, restart count 0 May 15 01:22:46.566: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.566: INFO: Container kube-scheduler ready: true, restart count 0 May 15 01:22:46.566: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:22:46.566: INFO: Container docker-registry ready: true, restart count 0 May 15 01:22:46.566: INFO: Container nginx ready: true, restart count 0 May 15 01:22:46.566: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.566: INFO: Container nfd-controller ready: true, restart count 0 May 15 01:22:46.566: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.566: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:22:46.566: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.566: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:22:46.566: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.566: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:22:46.566: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.566: INFO: Container kube-multus ready: true, restart count 1 W0515 01:22:46.579841 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:22:46.614: INFO: Latency metrics for node master1 May 15 01:22:46.614: INFO: Logging node info for node master2 May 15 01:22:46.616: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 145894 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:40 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:40 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:40 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:22:40 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:22:46.617: INFO: Logging kubelet events for node master2 May 15 01:22:46.621: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:22:46.637: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.637: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:22:46.637: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.637: INFO: Container kube-multus ready: true, restart count 1 May 15 01:22:46.637: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.637: INFO: Container coredns ready: true, restart count 0 May 15 01:22:46.637: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.637: INFO: Container autoscaler ready: true, restart count 2 May 15 01:22:46.637: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:22:46.637: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:46.637: INFO: Container node-exporter ready: true, restart count 0 May 15 01:22:46.637: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:22:46.637: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:46.637: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:22:46.637: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.637: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:22:46.637: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.637: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:22:46.637: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.637: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:22:46.637: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:22:46.637: INFO: Init container install-cni ready: true, restart count 0 May 15 01:22:46.637: INFO: Container kube-flannel ready: true, restart count 1 W0515 01:22:46.650198 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:22:46.676: INFO: Latency metrics for node master2 May 15 01:22:46.676: INFO: Logging node info for node master3 May 15 01:22:46.680: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 145886 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:38 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:22:38 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:22:46.680: INFO: Logging kubelet events for node master3 May 15 01:22:46.686: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:22:46.703: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.703: INFO: Container kube-scheduler ready: true, restart count 3 May 15 01:22:46.703: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.703: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:22:46.703: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.703: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:22:46.703: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:22:46.703: INFO: Init container install-cni ready: true, restart count 0 May 15 01:22:46.703: INFO: Container kube-flannel ready: true, restart count 2 May 15 01:22:46.703: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.703: INFO: Container kube-multus ready: true, restart count 1 May 15 01:22:46.703: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.703: INFO: Container coredns ready: true, restart count 0 May 15 01:22:46.703: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:22:46.703: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:46.703: INFO: Container node-exporter ready: true, restart count 0 May 15 01:22:46.703: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.703: INFO: Container kube-controller-manager ready: true, restart count 3 W0515 01:22:46.714702 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:22:46.739: INFO: Latency metrics for node master3 May 15 01:22:46.739: INFO: Logging node info for node node1 May 15 01:22:46.742: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 145905 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:22:46.743: INFO: Logging kubelet events for node node1 May 15 01:22:46.747: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:22:46.763: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.763: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:22:46.763: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.763: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:22:46.763: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.763: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:22:46.763: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:22:46.763: INFO: Init container install-cni ready: true, restart count 0 May 15 01:22:46.763: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:22:46.763: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.763: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:22:46.763: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:22:46.763: INFO: Container collectd ready: true, restart count 0 May 15 01:22:46.763: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:22:46.763: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:22:46.763: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.763: INFO: Container kube-multus ready: true, restart count 1 May 15 01:22:46.763: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:22:46.763: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:22:46.763: INFO: Container grafana ready: false, restart count 0 May 15 01:22:46.763: INFO: Container prometheus ready: false, restart count 24 May 15 01:22:46.763: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:22:46.763: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:22:46.763: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:22:46.763: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:46.763: INFO: Container node-exporter ready: true, restart count 0 May 15 01:22:46.763: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:22:46.763: INFO: Container nodereport ready: true, restart count 0 May 15 01:22:46.763: INFO: Container reconcile ready: true, restart count 0 W0515 01:22:46.775445 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:22:46.821: INFO: Latency metrics for node node1 May 15 01:22:46.821: INFO: Logging node info for node node2 May 15 01:22:46.823: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 145904 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:22:46.824: INFO: Logging kubelet events for node node2 May 15 01:22:46.828: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:22:46.845: INFO: pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321 started at 2021-05-15 01:17:47 +0000 UTC (1+1 container statuses recorded) May 15 01:22:46.845: INFO: Init container foo ready: false, restart count 0 May 15 01:22:46.845: INFO: Container bar ready: false, restart count 0 May 15 01:22:46.845: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:22:46.845: INFO: Container tas-controller ready: true, restart count 0 May 15 01:22:46.845: INFO: Container tas-extender ready: true, restart count 0 May 15 01:22:46.845: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:22:46.845: INFO: Container collectd ready: true, restart count 0 May 15 01:22:46.845: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:22:46.845: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:22:46.845: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.845: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:22:46.845: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.845: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:22:46.845: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:22:46.845: INFO: Container nodereport ready: true, restart count 0 May 15 01:22:46.845: INFO: Container reconcile ready: true, restart count 0 May 15 01:22:46.845: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.845: INFO: Container cmk-webhook ready: true, restart count 0 May 15 01:22:46.845: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:22:46.845: INFO: Container discover ready: false, restart count 0 May 15 01:22:46.845: INFO: Container init ready: false, restart count 0 May 15 01:22:46.845: INFO: Container install ready: false, restart count 0 May 15 01:22:46.845: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.845: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:22:46.845: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.845: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:22:46.845: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.845: INFO: Container kube-multus ready: true, restart count 1 May 15 01:22:46.845: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.845: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:22:46.845: INFO: master started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:22:46.845: INFO: Container cntr ready: false, restart count 0 May 15 01:22:46.845: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:22:46.845: INFO: Init container install-cni ready: true, restart count 1 May 15 01:22:46.845: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:22:46.845: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:22:46.845: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:46.845: INFO: Container node-exporter ready: true, restart count 0 W0515 01:22:46.858419 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:22:46.903: INFO: Latency metrics for node node2 May 15 01:22:46.903: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "mount-propagation-3211" for this suite. • Failure [302.582 seconds] [k8s.io] [sig-node] Mount propagation /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should propagate mounts to the host [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/mount_propagation.go:82 May 15 01:22:44.380: Unexpected error: <*errors.errorString | 0xc0002ba200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] Mount propagation should propagate mounts to the host","total":-1,"completed":0,"skipped":184,"failed":2,"failures":["[k8s.io] [sig-node] Security Context should support seccomp alpha runtime/default annotation [Feature:Seccomp] [LinuxOnly]","[k8s.io] [sig-node] Mount propagation should propagate mounts to the host"]} May 15 01:22:46.916: INFO: Running AfterSuite actions on all nodes [BeforeEach] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 15 01:17:47.744: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pod Container lifecycle /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:442 [It] should not create extra sandbox if all containers are done /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:446 STEP: creating the pod that should always exit 0 STEP: submitting the pod to kubernetes May 15 01:17:47.780: INFO: Waiting up to 5m0s for pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321" in namespace "pods-2310" to be "Succeeded or Failed" May 15 01:17:47.783: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2.804504ms May 15 01:17:49.787: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007256451s May 15 01:17:51.790: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009655102s May 15 01:17:53.793: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013426845s May 15 01:17:55.796: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015861784s May 15 01:17:57.798: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 10.018420312s May 15 01:17:59.802: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 12.022123248s May 15 01:18:01.805: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 14.025120715s May 15 01:18:03.807: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 16.027613507s May 15 01:18:05.810: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 18.029851698s May 15 01:18:07.812: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 20.032454823s May 15 01:18:09.815: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 22.035097804s May 15 01:18:11.818: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 24.038057785s May 15 01:18:13.820: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 26.040613709s May 15 01:18:15.824: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 28.04373525s May 15 01:18:17.827: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 30.047495929s May 15 01:18:19.831: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 32.051568832s May 15 01:18:21.835: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 34.055063613s May 15 01:18:23.838: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 36.057921705s May 15 01:18:25.842: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 38.062526559s May 15 01:18:27.846: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 40.066508603s May 15 01:18:29.851: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 42.071221324s May 15 01:18:31.855: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 44.074811425s May 15 01:18:33.858: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 46.07845947s May 15 01:18:35.862: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 48.081917681s May 15 01:18:37.866: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 50.086208938s May 15 01:18:39.870: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 52.090614625s May 15 01:18:41.874: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 54.093715s May 15 01:18:43.877: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 56.096826565s May 15 01:18:45.880: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 58.100433096s May 15 01:18:47.883: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.103386437s May 15 01:18:49.886: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.106529246s May 15 01:18:51.891: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.110742291s May 15 01:18:53.894: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.114052005s May 15 01:18:55.898: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.117824949s May 15 01:18:57.902: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.122237549s May 15 01:18:59.906: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.125792916s May 15 01:19:01.909: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.128999814s May 15 01:19:03.913: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.132735077s May 15 01:19:05.916: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.135684945s May 15 01:19:07.918: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.138245188s May 15 01:19:09.921: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.140899343s May 15 01:19:11.926: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.145748294s May 15 01:19:13.928: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.14801923s May 15 01:19:15.931: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.151363371s May 15 01:19:17.934: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.154512877s May 15 01:19:19.937: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.157254652s May 15 01:19:21.940: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.160232919s May 15 01:19:23.944: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.163653578s May 15 01:19:25.946: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.166462988s May 15 01:19:27.949: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.169570421s May 15 01:19:29.954: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.173810776s May 15 01:19:31.957: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.177326893s May 15 01:19:33.960: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.180107886s May 15 01:19:35.965: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.184917355s May 15 01:19:37.969: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.188650401s May 15 01:19:39.972: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.192509428s May 15 01:19:41.976: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.195990857s May 15 01:19:43.980: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.199663665s May 15 01:19:45.982: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.202561627s May 15 01:19:47.985: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.205267959s May 15 01:19:49.989: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.209366151s May 15 01:19:51.995: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.215466296s May 15 01:19:53.999: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.219000004s May 15 01:19:56.007: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.227604165s May 15 01:19:58.013: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.232663736s May 15 01:20:00.017: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.236748866s May 15 01:20:02.021: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.241115573s May 15 01:20:04.025: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.245304519s May 15 01:20:06.029: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.24963678s May 15 01:20:08.035: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.255022606s May 15 01:20:10.039: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.258839652s May 15 01:20:12.043: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.263092446s May 15 01:20:14.046: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.266032573s May 15 01:20:16.051: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.271071398s May 15 01:20:18.055: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.275141332s May 15 01:20:20.062: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.282135876s May 15 01:20:22.067: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.28750807s May 15 01:20:24.071: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.290994222s May 15 01:20:26.075: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.294723332s May 15 01:20:28.078: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.297905679s May 15 01:20:30.083: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.302716126s May 15 01:20:32.090: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.310534102s May 15 01:20:34.094: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.314423822s May 15 01:20:36.102: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.322020353s May 15 01:20:38.106: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.326516488s May 15 01:20:40.112: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.331762475s May 15 01:20:42.117: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.337338479s May 15 01:20:44.121: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.341288853s May 15 01:20:46.125: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.345318168s May 15 01:20:48.130: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.350541788s May 15 01:20:50.135: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.355627263s May 15 01:20:52.142: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.361987989s May 15 01:20:54.145: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.365558847s May 15 01:20:56.150: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.370567518s May 15 01:20:58.156: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.375818818s May 15 01:21:00.161: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.381563672s May 15 01:21:02.165: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.385603206s May 15 01:21:04.169: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.389575719s May 15 01:21:06.174: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.393696652s May 15 01:21:08.178: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.39858051s May 15 01:21:10.183: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.402865727s May 15 01:21:12.187: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.406939369s May 15 01:21:14.192: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.411890352s May 15 01:21:16.196: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.416382789s May 15 01:21:18.200: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.42053794s May 15 01:21:20.206: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.425711792s May 15 01:21:22.210: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.429768656s May 15 01:21:24.214: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.43402154s May 15 01:21:26.219: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.439094218s May 15 01:21:28.223: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.442741155s May 15 01:21:30.228: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.447838844s May 15 01:21:32.231: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.451030321s May 15 01:21:34.234: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.45457147s May 15 01:21:36.242: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.462594578s May 15 01:21:38.247: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.466736973s May 15 01:21:40.251: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.470823756s May 15 01:21:42.254: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.473650638s May 15 01:21:44.258: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.478562662s May 15 01:21:46.264: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.483838507s May 15 01:21:48.267: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.486782514s May 15 01:21:50.270: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.490490583s May 15 01:21:52.274: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.493948757s May 15 01:21:54.277: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.497275122s May 15 01:21:56.283: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.502995079s May 15 01:21:58.286: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.506083855s May 15 01:22:00.291: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.510800623s May 15 01:22:02.294: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.514643748s May 15 01:22:04.299: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.519342479s May 15 01:22:06.304: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.524516106s May 15 01:22:08.311: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.530821397s May 15 01:22:10.314: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.53388208s May 15 01:22:12.317: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.53743043s May 15 01:22:14.321: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.541356167s May 15 01:22:16.329: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.549059769s May 15 01:22:18.334: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.554089322s May 15 01:22:20.339: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.558730254s May 15 01:22:22.342: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.561937337s May 15 01:22:24.346: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.566040175s May 15 01:22:26.351: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.570851733s May 15 01:22:28.356: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.575788686s May 15 01:22:30.361: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.581550343s May 15 01:22:32.365: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.585164522s May 15 01:22:34.369: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.589618005s May 15 01:22:36.375: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.595408778s May 15 01:22:38.381: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.600676821s May 15 01:22:40.385: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.604650904s May 15 01:22:42.387: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.607520114s May 15 01:22:44.392: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.612498678s May 15 01:22:46.397: INFO: Pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.616764533s May 15 01:22:48.399: FAIL: Unexpected error: <*errors.errorString | 0xc004696da0>: { s: "Gave up after waiting 5m0s for pod \"pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321\" to be \"Succeeded or Failed\"", } Gave up after waiting 5m0s for pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/node.glob..func10.4.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:485 +0x58c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00297c180) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00297c180) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00297c180, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 STEP: deleting the pod [AfterEach] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-2310". STEP: Found 8 events. May 15 01:22:48.408: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321: { } Scheduled: Successfully assigned pods-2310/pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321 to node2 May 15 01:22:48.408: INFO: At 2021-05-15 01:17:50 +0000 UTC - event for pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321: {multus } AddedInterface: Add eth0 [10.244.4.153/24] May 15 01:22:48.408: INFO: At 2021-05-15 01:17:50 +0000 UTC - event for pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 15 01:22:48.408: INFO: At 2021-05-15 01:17:51 +0000 UTC - event for pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:22:48.408: INFO: At 2021-05-15 01:17:51 +0000 UTC - event for pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321: {kubelet node2} Failed: Error: ErrImagePull May 15 01:22:48.409: INFO: At 2021-05-15 01:17:51 +0000 UTC - event for pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 15 01:22:48.409: INFO: At 2021-05-15 01:17:51 +0000 UTC - event for pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321: {kubelet node2} Failed: Error: ImagePullBackOff May 15 01:22:48.409: INFO: At 2021-05-15 01:19:25 +0000 UTC - event for pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 15 01:22:48.410: INFO: POD NODE PHASE GRACE CONDITIONS May 15 01:22:48.410: INFO: pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321 node2 Pending 30s [{Initialized False 0001-01-01 00:00:00 +0000 UTC 2021-05-15 01:17:47 +0000 UTC ContainersNotInitialized containers with incomplete status: [foo]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-15 01:17:47 +0000 UTC ContainersNotReady containers with unready status: [bar]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-15 01:17:47 +0000 UTC ContainersNotReady containers with unready status: [bar]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-15 01:17:47 +0000 UTC }] May 15 01:22:48.410: INFO: May 15 01:22:48.414: INFO: Logging node info for node master1 May 15 01:22:48.416: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 145903 0 2021-05-14 19:56:35 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:42 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:42 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:42 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:22:42 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:22:48.417: INFO: Logging kubelet events for node master1 May 15 01:22:48.421: INFO: Logging pods the kubelet thinks is on node master1 May 15 01:22:48.429: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.429: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:22:48.429: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:22:48.429: INFO: Init container install-cni ready: true, restart count 0 May 15 01:22:48.429: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:22:48.429: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:22:48.429: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:48.429: INFO: Container node-exporter ready: true, restart count 0 May 15 01:22:48.429: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.429: INFO: Container kube-scheduler ready: true, restart count 0 May 15 01:22:48.429: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.429: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:22:48.429: INFO: kubernetes-metrics-scraper-678c97765c-fswrn started at 2021-05-15 00:18:49 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.429: INFO: Container kubernetes-metrics-scraper ready: true, restart count 0 May 15 01:22:48.429: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.429: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:22:48.429: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.429: INFO: Container kube-multus ready: true, restart count 1 May 15 01:22:48.429: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 15 01:22:48.429: INFO: Container docker-registry ready: true, restart count 0 May 15 01:22:48.429: INFO: Container nginx ready: true, restart count 0 May 15 01:22:48.429: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.429: INFO: Container nfd-controller ready: true, restart count 0 W0515 01:22:48.441027 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:22:48.466: INFO: Latency metrics for node master1 May 15 01:22:48.466: INFO: Logging node info for node master2 May 15 01:22:48.468: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 145894 0 2021-05-14 19:57:04 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:40 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:40 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:40 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:22:40 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:22:48.469: INFO: Logging kubelet events for node master2 May 15 01:22:48.473: INFO: Logging pods the kubelet thinks is on node master2 May 15 01:22:48.480: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:22:48.481: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:48.481: INFO: Container node-exporter ready: true, restart count 0 May 15 01:22:48.481: INFO: prometheus-operator-5bb8cb9d8f-fqb87 started at 2021-05-15 00:18:49 +0000 UTC (0+2 container statuses recorded) May 15 01:22:48.481: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:48.481: INFO: Container prometheus-operator ready: true, restart count 0 May 15 01:22:48.481: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.481: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:22:48.481: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.481: INFO: Container kube-controller-manager ready: true, restart count 2 May 15 01:22:48.481: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.481: INFO: Container kube-scheduler ready: true, restart count 2 May 15 01:22:48.481: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:22:48.481: INFO: Init container install-cni ready: true, restart count 0 May 15 01:22:48.481: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:22:48.481: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.481: INFO: Container autoscaler ready: true, restart count 2 May 15 01:22:48.481: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.481: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:22:48.481: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.481: INFO: Container kube-multus ready: true, restart count 1 May 15 01:22:48.481: INFO: coredns-7677f9bb54-96w24 started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.481: INFO: Container coredns ready: true, restart count 0 W0515 01:22:48.494963 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:22:48.521: INFO: Latency metrics for node master2 May 15 01:22:48.521: INFO: Logging node info for node master3 May 15 01:22:48.523: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 145940 0 2021-05-14 19:57:14 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:48 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:22:48 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:22:48.524: INFO: Logging kubelet events for node master3 May 15 01:22:48.529: INFO: Logging pods the kubelet thinks is on node master3 May 15 01:22:48.537: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.537: INFO: Container kube-apiserver ready: true, restart count 0 May 15 01:22:48.537: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.537: INFO: Container kube-proxy ready: true, restart count 1 May 15 01:22:48.537: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:22:48.537: INFO: Init container install-cni ready: true, restart count 0 May 15 01:22:48.537: INFO: Container kube-flannel ready: true, restart count 2 May 15 01:22:48.537: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.537: INFO: Container kube-multus ready: true, restart count 1 May 15 01:22:48.537: INFO: coredns-7677f9bb54-rpj8c started at 2021-05-15 01:12:26 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.537: INFO: Container coredns ready: true, restart count 0 May 15 01:22:48.537: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:22:48.537: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:48.537: INFO: Container node-exporter ready: true, restart count 0 May 15 01:22:48.537: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.537: INFO: Container kube-controller-manager ready: true, restart count 3 May 15 01:22:48.537: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.537: INFO: Container kube-scheduler ready: true, restart count 3 W0515 01:22:48.550029 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:22:48.581: INFO: Latency metrics for node master3 May 15 01:22:48.581: INFO: Logging node info for node node1 May 15 01:22:48.584: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 145905 0 2021-05-14 19:58:21 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[@ :],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:22:48.585: INFO: Logging kubelet events for node node1 May 15 01:22:48.589: INFO: Logging pods the kubelet thinks is on node node1 May 15 01:22:48.601: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.601: INFO: Container kube-multus ready: true, restart count 1 May 15 01:22:48.601: INFO: prometheus-k8s-0 started at 2021-05-15 00:19:01 +0000 UTC (0+5 container statuses recorded) May 15 01:22:48.601: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 15 01:22:48.601: INFO: Container grafana ready: false, restart count 0 May 15 01:22:48.601: INFO: Container prometheus ready: false, restart count 24 May 15 01:22:48.601: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 15 01:22:48.601: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 15 01:22:48.601: INFO: node-exporter-flvqz started at 2021-05-15 00:18:55 +0000 UTC (0+2 container statuses recorded) May 15 01:22:48.601: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:48.601: INFO: Container node-exporter ready: true, restart count 0 May 15 01:22:48.601: INFO: cmk-4s6dm started at 2021-05-15 00:18:54 +0000 UTC (0+2 container statuses recorded) May 15 01:22:48.601: INFO: Container nodereport ready: true, restart count 0 May 15 01:22:48.601: INFO: Container reconcile ready: true, restart count 0 May 15 01:22:48.601: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.601: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:22:48.601: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-4vxcc started at 2021-05-15 00:19:00 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.601: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:22:48.601: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.601: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:22:48.601: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:22:48.601: INFO: Init container install-cni ready: true, restart count 0 May 15 01:22:48.601: INFO: Container kube-flannel ready: true, restart count 1 May 15 01:22:48.601: INFO: node-feature-discovery-worker-bw8zg started at 2021-05-15 00:18:56 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.601: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:22:48.601: INFO: collectd-mrzps started at 2021-05-15 00:19:22 +0000 UTC (0+3 container statuses recorded) May 15 01:22:48.601: INFO: Container collectd ready: true, restart count 0 May 15 01:22:48.601: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:22:48.601: INFO: Container rbac-proxy ready: true, restart count 0 W0515 01:22:48.613542 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:22:48.646: INFO: Latency metrics for node node1 May 15 01:22:48.646: INFO: Logging node info for node node2 May 15 01:22:48.649: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 145904 0 2021-05-14 19:58:22 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 22:28:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:example.com/fakecpu":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {e2e.test Update v1 2021-05-15 01:12:39 +0000 UTC FieldsV1 {"f:status":{"f:capacity":{"f:example.com/fakecpu":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},example.com/fakecpu: {{1 3} {} 1k DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-15 01:22:43 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 15 01:22:48.649: INFO: Logging kubelet events for node node2 May 15 01:22:48.654: INFO: Logging pods the kubelet thinks is on node node2 May 15 01:22:48.663: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 15 01:22:48.663: INFO: Container tas-controller ready: true, restart count 0 May 15 01:22:48.663: INFO: Container tas-extender ready: true, restart count 0 May 15 01:22:48.663: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 15 01:22:48.663: INFO: Container collectd ready: true, restart count 0 May 15 01:22:48.663: INFO: Container collectd-exporter ready: true, restart count 0 May 15 01:22:48.663: INFO: Container rbac-proxy ready: true, restart count 0 May 15 01:22:48.663: INFO: pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321 started at 2021-05-15 01:17:47 +0000 UTC (1+1 container statuses recorded) May 15 01:22:48.663: INFO: Init container foo ready: false, restart count 0 May 15 01:22:48.663: INFO: Container bar ready: false, restart count 0 May 15 01:22:48.663: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.663: INFO: Container kube-sriovdp ready: true, restart count 0 May 15 01:22:48.663: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.663: INFO: Container nfd-worker ready: true, restart count 0 May 15 01:22:48.663: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 15 01:22:48.663: INFO: Container nodereport ready: true, restart count 0 May 15 01:22:48.663: INFO: Container reconcile ready: true, restart count 0 May 15 01:22:48.663: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.663: INFO: Container cmk-webhook ready: true, restart count 0 May 15 01:22:48.663: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 15 01:22:48.663: INFO: Container discover ready: false, restart count 0 May 15 01:22:48.663: INFO: Container init ready: false, restart count 0 May 15 01:22:48.663: INFO: Container install ready: false, restart count 0 May 15 01:22:48.663: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.663: INFO: Container kube-proxy ready: true, restart count 2 May 15 01:22:48.663: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.663: INFO: Container kube-multus ready: true, restart count 1 May 15 01:22:48.663: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.663: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 15 01:22:48.663: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.663: INFO: Container nginx-proxy ready: true, restart count 2 May 15 01:22:48.663: INFO: master started at 2021-05-15 01:17:44 +0000 UTC (0+1 container statuses recorded) May 15 01:22:48.663: INFO: Container cntr ready: false, restart count 0 May 15 01:22:48.663: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 15 01:22:48.663: INFO: Init container install-cni ready: true, restart count 1 May 15 01:22:48.663: INFO: Container kube-flannel ready: true, restart count 4 May 15 01:22:48.663: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 15 01:22:48.663: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 15 01:22:48.663: INFO: Container node-exporter ready: true, restart count 0 W0515 01:22:48.675524 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 15 01:22:48.707: INFO: Latency metrics for node node2 May 15 01:22:48.707: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-2310" for this suite. • Failure [300.972 seconds] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 [k8s.io] Pod Container lifecycle /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should not create extra sandbox if all containers are done [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:446 May 15 01:22:48.399: Unexpected error: <*errors.errorString | 0xc004696da0>: { s: "Gave up after waiting 5m0s for pod \"pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321\" to be \"Succeeded or Failed\"", } Gave up after waiting 5m0s for pod "pod-always-succeeda6d36007-fb63-41a7-b7b4-b33afb152321" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:485 ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] Pods Extended [k8s.io] Pod Container lifecycle should not create extra sandbox if all containers are done","total":-1,"completed":0,"skipped":656,"failed":2,"failures":["[k8s.io] [sig-node] Security Context should support pod.Spec.SecurityContext.SupplementalGroups [LinuxOnly]","[k8s.io] [sig-node] Pods Extended [k8s.io] Pod Container lifecycle should not create extra sandbox if all containers are done"]} May 15 01:22:48.722: INFO: Running AfterSuite actions on all nodes {"msg":"FAILED [k8s.io] [sig-node] Security Context should support pod.Spec.SecurityContext.RunAsUser And pod.Spec.SecurityContext.RunAsGroup [LinuxOnly]","total":-1,"completed":0,"skipped":834,"failed":1,"failures":["[k8s.io] [sig-node] Security Context should support pod.Spec.SecurityContext.RunAsUser And pod.Spec.SecurityContext.RunAsGroup [LinuxOnly]"]} May 15 01:17:51.670: INFO: Running AfterSuite actions on all nodes May 15 01:22:48.790: INFO: Running AfterSuite actions on node 1 May 15 01:22:48.790: INFO: Skipping dumping logs from cluster Summarizing 12 Failures: [Fail] [k8s.io] [sig-node] Security Context [It] should support pod.Spec.SecurityContext.RunAsUser [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] [sig-node] Security Context [It] should support seccomp alpha runtime/default annotation [Feature:Seccomp] [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] [sig-node] Security Context [It] should support seccomp alpha unconfined annotation on the pod [Feature:Seccomp] [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] [sig-node] Security Context [It] should support container.SecurityContext.RunAsUser And container.SecurityContext.RunAsGroup [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] [sig-node] Security Context [It] should support pod.Spec.SecurityContext.SupplementalGroups [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [sig-node] Downward API [It] should provide host IP and pod IP as an env var if pod uses host network [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] [sig-node] Security Context [It] should support pod.Spec.SecurityContext.RunAsUser And pod.Spec.SecurityContext.RunAsGroup [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] [sig-node] Security Context [It] should support container.SecurityContext.RunAsUser [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] [sig-node] Security Context [It] should support seccomp default which is unconfined [Feature:Seccomp] [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] [sig-node] Security Context [It] should support seccomp alpha unconfined annotation on the container [Feature:Seccomp] [LinuxOnly] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] [sig-node] Mount propagation [It] should propagate mounts to the host /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [Fail] [k8s.io] [sig-node] Pods Extended [k8s.io] Pod Container lifecycle [It] should not create extra sandbox if all containers are done /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:485 Ran 16 of 5484 Specs in 610.174 seconds FAIL! -- 4 Passed | 12 Failed | 0 Pending | 5468 Skipped Ginkgo ran 1 suite in 10m11.619500429s Test Suite Failed