I0119 22:14:27.727849 16 e2e.go:109] Starting e2e run "33d0e5e4-f3ac-488e-a273-8cebb72fdf17" on Ginkgo node 1 Running Suite: Kubernetes e2e suite - /usr/local/bin ==================================================== Random Seed: 1737324866 - will randomize all specs Will run 16 of 7199 specs SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [FAILED] [161.494 seconds] [sig-scheduling] SchedulerPredicates [Serial] validates pod overhead is considered along with resource limits of pods that are allowed to run [BeforeEach] verify pod overhead is accounted for [sig-scheduling, Serial] [BeforeEach] k8s.io/kubernetes/test/e2e/scheduling/predicates.go:224 [It] k8s.io/kubernetes/test/e2e/scheduling/predicates.go:279 Timeline >> STEP: Creating a kubernetes client @ 01/19/25 22:17:20.467 I0119 22:17:20.467766 16 util.go:506] >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename sched-pred @ 01/19/25 22:17:20.468 STEP: Waiting for a default service account to be provisioned in namespace @ 01/19/25 22:17:20.474 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace @ 01/19/25 22:17:20.476 I0119 22:17:20.480255 16 helper.go:121] Waiting up to 1m0s for all (but 0) nodes to be ready I0119 22:17:20.494926 16 util.go:400] Waiting for terminating namespaces to be deleted... I0119 22:17:20.498818 16 predicates.go:121] Logging pods the apiserver thinks is on node v130-worker before test I0119 22:17:20.511180 16 predicates.go:887] rally-42b8a842-ou8ijyha from c-rally-42b8a842-vb58peys started at 2025-01-19 22:16:45 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511209 16 predicates.go:889] Container rally-42b8a842-ou8ijyha ready: true, restart count 0 I0119 22:17:20.511222 16 predicates.go:887] busybox-dbf18385-5abb-42ce-b999-ab2e02652a14 from container-probe-1264 started at 2025-01-19 22:15:27 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511230 16 predicates.go:889] Container busybox ready: true, restart count 0 I0119 22:17:20.511242 16 predicates.go:887] probe-test-7b8090b8-5983-4817-a5f0-89245ef3eaac from container-probe-8897 started at 2025-01-19 22:16:27 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511250 16 predicates.go:889] Container probe-test-7b8090b8-5983-4817-a5f0-89245ef3eaac ready: false, restart count 0 I0119 22:17:20.511258 16 predicates.go:887] terminate-cmd-rpn3f685da3-7b12-4e78-bddb-3476e625ba8f from container-runtime-538 started at 2025-01-19 22:17:07 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511262 16 predicates.go:889] Container terminate-cmd-rpn ready: false, restart count 0 I0119 22:17:20.511267 16 predicates.go:887] image-pull-test8f2d8874-3154-4f58-9434-755d81efe5ab from container-runtime-6865 started at 2025-01-19 22:16:59 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511272 16 predicates.go:889] Container image-pull-test ready: false, restart count 0 I0119 22:17:20.511277 16 predicates.go:887] rs-2tl5x from disruption-4217 started at 2025-01-19 22:17:10 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511281 16 predicates.go:889] Container donothing ready: false, restart count 0 I0119 22:17:20.511285 16 predicates.go:887] downwardapi-volume-c1afc206-13e0-4242-a850-5dc98213a53e from downward-api-6783 started at 2025-01-19 22:16:39 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511289 16 predicates.go:889] Container client-container ready: true, restart count 0 I0119 22:17:20.511294 16 predicates.go:887] pod-be9ee9d1-448f-461a-92a5-edb9c5428acd from emptydir-10 started at 2025-01-19 22:17:07 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511298 16 predicates.go:889] Container test-container ready: false, restart count 0 I0119 22:17:20.511302 16 predicates.go:887] send-events-882d97c9-3b22-4a5f-ad97-d5aea77a8b1e from events-8744 started at 2025-01-19 22:17:05 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511306 16 predicates.go:889] Container p ready: false, restart count 0 I0119 22:17:20.511310 16 predicates.go:887] create-loop-devs-ltqc4 from kube-system started at 2025-01-19 16:27:54 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511313 16 predicates.go:889] Container loopdev ready: true, restart count 0 I0119 22:17:20.511318 16 predicates.go:887] kindnet-l85ml from kube-system started at 2025-01-19 16:27:53 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511324 16 predicates.go:889] Container kindnet-cni ready: true, restart count 0 I0119 22:17:20.511329 16 predicates.go:887] kube-proxy-4tgfc from kube-system started at 2025-01-19 16:27:53 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511333 16 predicates.go:889] Container kube-proxy ready: true, restart count 0 I0119 22:17:20.511338 16 predicates.go:887] helper-pod-create-pvc-81329e85-c7f3-4a07-9dd6-1997bef3880a from local-path-storage started at 2025-01-19 22:16:46 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511342 16 predicates.go:889] Container helper-pod ready: false, restart count 0 I0119 22:17:20.511346 16 predicates.go:887] helper-pod-delete-pvc-78a22eb1-11ed-41d3-8490-a1aff77f8388 from local-path-storage started at 2025-01-19 22:17:04 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511350 16 predicates.go:889] Container helper-pod ready: false, restart count 0 I0119 22:17:20.511354 16 predicates.go:887] netserver-0 from nettest-2522 started at 2025-01-19 22:16:52 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511359 16 predicates.go:889] Container webserver ready: false, restart count 0 I0119 22:17:20.511363 16 predicates.go:887] netserver-0 from nettest-2554 started at 2025-01-19 22:16:53 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511367 16 predicates.go:889] Container webserver ready: false, restart count 0 I0119 22:17:20.511372 16 predicates.go:887] netserver-0 from nettest-3140 started at 2025-01-19 22:17:01 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511375 16 predicates.go:889] Container webserver ready: false, restart count 0 I0119 22:17:20.511380 16 predicates.go:887] netserver-0 from nettest-404 started at 2025-01-19 22:16:52 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511383 16 predicates.go:889] Container webserver ready: false, restart count 0 I0119 22:17:20.511387 16 predicates.go:887] no-snat-testp8jp5 from no-snat-test-7612 started at 2025-01-19 22:16:30 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511391 16 predicates.go:889] Container no-snat-test ready: false, restart count 0 I0119 22:17:20.511396 16 predicates.go:887] pod-should-be-evicted7e95a87e-2c9e-42ab-b948-ac5d27312f04 from pods-2187 started at 2025-01-19 22:17:00 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511399 16 predicates.go:889] Container bar ready: false, restart count 0 I0119 22:17:20.511404 16 predicates.go:887] pod-terminate-status-0-7 from pods-3415 started at 2025-01-19 22:17:03 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511407 16 predicates.go:889] Container blocked ready: false, restart count 0 I0119 22:17:20.511411 16 predicates.go:887] pod-terminate-status-1-5 from pods-3415 started at 2025-01-19 22:17:03 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511415 16 predicates.go:889] Container blocked ready: false, restart count 0 I0119 22:17:20.511419 16 predicates.go:887] pod-terminate-status-2-7 from pods-3415 started at 2025-01-19 22:17:03 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511422 16 predicates.go:889] Container blocked ready: false, restart count 0 I0119 22:17:20.511427 16 predicates.go:887] pod-terminate-status-0-5 from pods-5994 started at 2025-01-19 22:16:14 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511430 16 predicates.go:889] Container fail ready: false, restart count 0 I0119 22:17:20.511434 16 predicates.go:887] back-off-cap from pods-7761 started at 2025-01-19 22:12:36 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511437 16 predicates.go:889] Container back-off-cap ready: false, restart count 5 I0119 22:17:20.511441 16 predicates.go:887] pod-submit-remove-cb6a6ed3-149a-4940-be21-fd53a3d56147 from pods-8463 started at 2025-01-19 22:17:00 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511445 16 predicates.go:889] Container agnhost-container ready: true, restart count 0 I0119 22:17:20.511449 16 predicates.go:887] pod-projected-configmaps-f29fdfae-648a-4f3a-99b3-f432f6f90f0a from projected-2454 started at 2025-01-19 22:16:43 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511452 16 predicates.go:889] Container agnhost-container ready: true, restart count 0 I0119 22:17:20.511456 16 predicates.go:887] agnhost from proxy-8919 started at 2025-01-19 22:16:37 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511459 16 predicates.go:889] Container agnhost ready: false, restart count 0 I0119 22:17:20.511463 16 predicates.go:887] test-rs-ws2sl from replicaset-5836 started at 2025-01-19 22:17:19 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511467 16 predicates.go:889] Container httpd ready: false, restart count 0 I0119 22:17:20.511471 16 predicates.go:887] e2e-rc-gtjfl-wwzc5 from replication-controller-8102 started at 2025-01-19 22:17:18 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511476 16 predicates.go:889] Container httpd ready: false, restart count 0 I0119 22:17:20.511480 16 predicates.go:887] pod4 from sched-pred-8206 started at 2025-01-19 22:16:23 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511483 16 predicates.go:889] Container agnhost ready: true, restart count 0 I0119 22:17:20.511488 16 predicates.go:887] pod-with-label-security-s1 from sched-priority-7696 started at 2025-01-19 22:15:28 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511491 16 predicates.go:889] Container pod-with-label-security-s1 ready: true, restart count 0 I0119 22:17:20.511495 16 predicates.go:887] security-context-b0d26df5-6d32-432f-b30f-336a49e5783d from security-context-9974 started at 2025-01-19 22:17:00 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511498 16 predicates.go:889] Container test-container ready: false, restart count 0 I0119 22:17:20.511503 16 predicates.go:887] implicit-root-uid from security-context-test-9697 started at 2025-01-19 22:16:38 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511507 16 predicates.go:889] Container implicit-root-uid ready: false, restart count 0 I0119 22:17:20.511511 16 predicates.go:887] service-headless-kvqrr from services-3517 started at 2025-01-19 22:13:43 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511514 16 predicates.go:889] Container service-headless ready: true, restart count 0 I0119 22:17:20.511519 16 predicates.go:887] service-headless-tmvtj from services-3517 started at 2025-01-19 22:13:43 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511523 16 predicates.go:889] Container service-headless ready: true, restart count 0 I0119 22:17:20.511529 16 predicates.go:887] service-headless-toggled-vx5qf from services-3517 started at 2025-01-19 22:14:07 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511540 16 predicates.go:889] Container service-headless-toggled ready: true, restart count 0 I0119 22:17:20.511549 16 predicates.go:887] service-headless-toggled-zj7sc from services-3517 started at 2025-01-19 22:14:07 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511555 16 predicates.go:889] Container service-headless-toggled ready: true, restart count 0 I0119 22:17:20.511562 16 predicates.go:887] verify-service-down-host-exec-pod from services-3517 started at 2025-01-19 22:16:45 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511566 16 predicates.go:889] Container agnhost-container ready: true, restart count 0 I0119 22:17:20.511571 16 predicates.go:887] affinity-clusterip-timeout-7v6z4 from services-3597 started at 2025-01-19 22:13:49 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511575 16 predicates.go:889] Container affinity-clusterip-timeout ready: true, restart count 0 I0119 22:17:20.511579 16 predicates.go:887] affinity-clusterip-timeout-zwl5w from services-3597 started at 2025-01-19 22:13:49 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511583 16 predicates.go:889] Container affinity-clusterip-timeout ready: true, restart count 0 I0119 22:17:20.511588 16 predicates.go:887] webserver-pod from services-4235 started at 2025-01-19 22:15:55 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511591 16 predicates.go:889] Container agnhost ready: false, restart count 0 I0119 22:17:20.511596 16 predicates.go:887] webserver-pod from services-4594 started at 2025-01-19 22:12:17 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511600 16 predicates.go:889] Container agnhost ready: false, restart count 0 I0119 22:17:20.511604 16 predicates.go:887] echo-hostname-0 from services-5454 started at 2025-01-19 22:13:39 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511607 16 predicates.go:889] Container agnhost-container ready: false, restart count 0 I0119 22:17:20.511612 16 predicates.go:887] up-down-2-ssq7p from services-5506 started at 2025-01-19 22:12:26 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511615 16 predicates.go:889] Container up-down-2 ready: true, restart count 0 I0119 22:17:20.511620 16 predicates.go:887] up-down-3-7tt7w from services-5506 started at 2025-01-19 22:15:30 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511626 16 predicates.go:889] Container up-down-3 ready: true, restart count 0 I0119 22:17:20.511634 16 predicates.go:887] up-down-3-b9kcn from services-5506 started at 2025-01-19 22:15:30 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511639 16 predicates.go:889] Container up-down-3 ready: true, restart count 0 I0119 22:17:20.511643 16 predicates.go:887] service-proxy-disabled-wsfmr from services-5640 started at 2025-01-19 22:15:43 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511647 16 predicates.go:889] Container service-proxy-disabled ready: true, restart count 0 I0119 22:17:20.511653 16 predicates.go:887] service-proxy-toggled-ntqfk from services-5640 started at 2025-01-19 22:16:25 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511657 16 predicates.go:889] Container service-proxy-toggled ready: true, restart count 0 I0119 22:17:20.511662 16 predicates.go:887] service-proxy-toggled-r8hh7 from services-5640 started at 2025-01-19 22:16:25 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511666 16 predicates.go:889] Container service-proxy-toggled ready: true, restart count 0 I0119 22:17:20.511670 16 predicates.go:887] verify-service-down-host-exec-pod from services-5640 started at 2025-01-19 22:17:04 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511675 16 predicates.go:889] Container agnhost-container ready: false, restart count 0 I0119 22:17:20.511686 16 predicates.go:887] execpod-noendpointsbm5vk from services-5986 started at 2025-01-19 22:17:05 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511695 16 predicates.go:889] Container agnhost-container ready: false, restart count 0 I0119 22:17:20.511704 16 predicates.go:887] affinity-nodeport-timeout-ng9bg from services-8602 started at 2025-01-19 22:14:49 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511710 16 predicates.go:889] Container affinity-nodeport-timeout ready: true, restart count 0 I0119 22:17:20.511718 16 predicates.go:887] affinity-nodeport-timeout-x4rd4 from services-8602 started at 2025-01-19 22:14:49 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511724 16 predicates.go:889] Container affinity-nodeport-timeout ready: true, restart count 0 I0119 22:17:20.511732 16 predicates.go:887] execpod-affinity5b65x from services-8602 started at 2025-01-19 22:15:31 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511741 16 predicates.go:889] Container agnhost-container ready: true, restart count 0 I0119 22:17:20.511749 16 predicates.go:887] ss-0 from statefulset-2364 started at 2025-01-19 22:13:55 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511756 16 predicates.go:889] Container webserver ready: false, restart count 0 I0119 22:17:20.511767 16 predicates.go:887] ss-0 from statefulset-2726 started at 2025-01-19 22:15:45 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511774 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.511782 16 predicates.go:887] ss-0 from statefulset-3793 started at 2025-01-19 22:16:30 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511788 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.511797 16 predicates.go:887] ss-1 from statefulset-3793 started at 2025-01-19 22:16:03 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511803 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.511812 16 predicates.go:887] ss2-0 from statefulset-9112 started at 2025-01-19 22:15:42 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511818 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.511824 16 predicates.go:887] ss2-2 from statefulset-9112 started at 2025-01-19 22:17:07 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511830 16 predicates.go:889] Container webserver ready: false, restart count 0 I0119 22:17:20.511835 16 predicates.go:887] ss-0 from statefulset-9822 started at 2025-01-19 22:13:41 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511839 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.511844 16 predicates.go:887] ss-1 from statefulset-9822 started at 2025-01-19 22:17:04 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511847 16 predicates.go:889] Container webserver ready: false, restart count 0 I0119 22:17:20.511852 16 predicates.go:887] sample-webhook-deployment-6b869959d-f2jlv from webhook-6873 started at 2025-01-19 22:17:04 +0000 UTC (1 container statuses recorded) I0119 22:17:20.511856 16 predicates.go:889] Container sample-webhook ready: false, restart count 0 I0119 22:17:20.511861 16 predicates.go:121] Logging pods the apiserver thinks is on node v130-worker2 before test I0119 22:17:20.522068 16 predicates.go:887] rs-fmjv6 from disruption-4217 started at 2025-01-19 22:17:10 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522092 16 predicates.go:889] Container donothing ready: true, restart count 0 I0119 22:17:20.522098 16 predicates.go:887] create-loop-devs-zk7ps from kube-system started at 2025-01-19 16:27:54 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522103 16 predicates.go:889] Container loopdev ready: true, restart count 0 I0119 22:17:20.522108 16 predicates.go:887] kindnet-vwh7p from kube-system started at 2025-01-19 16:27:53 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522113 16 predicates.go:889] Container kindnet-cni ready: true, restart count 0 I0119 22:17:20.522118 16 predicates.go:887] kube-proxy-bfxlq from kube-system started at 2025-01-19 16:27:53 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522121 16 predicates.go:889] Container kube-proxy ready: true, restart count 0 I0119 22:17:20.522126 16 predicates.go:887] netserver-1 from nettest-2522 started at 2025-01-19 22:16:52 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522129 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.522134 16 predicates.go:887] netserver-1 from nettest-2554 started at 2025-01-19 22:16:53 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522137 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.522141 16 predicates.go:887] netserver-1 from nettest-3140 started at 2025-01-19 22:17:01 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522145 16 predicates.go:889] Container webserver ready: false, restart count 0 I0119 22:17:20.522149 16 predicates.go:887] netserver-1 from nettest-404 started at 2025-01-19 22:16:52 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522152 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.522157 16 predicates.go:887] pod-terminate-status-1-5 from pods-5994 started at 2025-01-19 22:17:16 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522162 16 predicates.go:889] Container fail ready: false, restart count 0 I0119 22:17:20.522166 16 predicates.go:887] pod-terminate-status-2-5 from pods-5994 started at 2025-01-19 22:17:14 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522169 16 predicates.go:889] Container fail ready: false, restart count 0 I0119 22:17:20.522174 16 predicates.go:887] pod-prestop-hook-afbb2e64-ad9d-4cc9-954d-66c44ebeb824 from prestop-6503 started at 2025-01-19 22:17:17 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522177 16 predicates.go:889] Container nginx ready: false, restart count 0 I0119 22:17:20.522181 16 predicates.go:887] test-rs-69vsv from replicaset-5836 started at 2025-01-19 22:17:19 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522185 16 predicates.go:889] Container httpd ready: false, restart count 0 I0119 22:17:20.522189 16 predicates.go:887] test-rs-wths7 from replicaset-5836 started at 2025-01-19 22:17:19 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522193 16 predicates.go:889] Container httpd ready: false, restart count 0 I0119 22:17:20.522198 16 predicates.go:887] e2e-rc-gtjfl-gz7ll from replication-controller-8102 started at 2025-01-19 22:17:17 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522201 16 predicates.go:889] Container httpd ready: false, restart count 0 I0119 22:17:20.522206 16 predicates.go:887] pod-with-pod-antiaffinity from sched-priority-7696 started at 2025-01-19 22:16:18 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522210 16 predicates.go:889] Container pod-with-pod-antiaffinity ready: true, restart count 0 I0119 22:17:20.522215 16 predicates.go:887] explicit-nonroot-uid from security-context-test-1687 started at 2025-01-19 22:17:09 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522218 16 predicates.go:889] Container explicit-nonroot-uid ready: false, restart count 0 I0119 22:17:20.522223 16 predicates.go:887] service-headless-9lpq2 from services-3517 started at 2025-01-19 22:13:43 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522228 16 predicates.go:889] Container service-headless ready: true, restart count 0 I0119 22:17:20.522232 16 predicates.go:887] service-headless-toggled-nbxhf from services-3517 started at 2025-01-19 22:14:07 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522236 16 predicates.go:889] Container service-headless-toggled ready: true, restart count 0 I0119 22:17:20.522240 16 predicates.go:887] affinity-clusterip-timeout-t9rnd from services-3597 started at 2025-01-19 22:13:49 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522243 16 predicates.go:889] Container affinity-clusterip-timeout ready: true, restart count 0 I0119 22:17:20.522248 16 predicates.go:887] pause-pod-1 from services-4235 started at 2025-01-19 22:16:15 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522251 16 predicates.go:889] Container agnhost-container ready: true, restart count 0 I0119 22:17:20.522256 16 predicates.go:887] service-proxy-disabled-b7dth from services-5640 started at 2025-01-19 22:15:43 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522259 16 predicates.go:889] Container service-proxy-disabled ready: true, restart count 0 I0119 22:17:20.522264 16 predicates.go:887] service-proxy-disabled-hgwcw from services-5640 started at 2025-01-19 22:15:43 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522268 16 predicates.go:889] Container service-proxy-disabled ready: true, restart count 0 I0119 22:17:20.522272 16 predicates.go:887] service-proxy-toggled-v7c94 from services-5640 started at 2025-01-19 22:16:25 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522275 16 predicates.go:889] Container service-proxy-toggled ready: true, restart count 0 I0119 22:17:20.522279 16 predicates.go:887] affinity-nodeport-timeout-lfxdz from services-8602 started at 2025-01-19 22:14:49 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522282 16 predicates.go:889] Container affinity-nodeport-timeout ready: true, restart count 0 I0119 22:17:20.522286 16 predicates.go:887] ss-1 from statefulset-2726 started at 2025-01-19 22:16:37 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522289 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.522294 16 predicates.go:887] ss2-1 from statefulset-9112 started at 2025-01-19 22:16:23 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522297 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.522302 16 predicates.go:887] ss-2 from statefulset-9822 started at 2025-01-19 22:16:07 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522305 16 predicates.go:889] Container webserver ready: true, restart count 0 I0119 22:17:20.522310 16 predicates.go:887] inclusterclient from svcaccounts-2660 started at 2025-01-19 22:10:37 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522313 16 predicates.go:889] Container inclusterclient ready: true, restart count 0 I0119 22:17:20.522317 16 predicates.go:887] oidc-discovery-validator from svcaccounts-580 started at 2025-01-19 22:16:55 +0000 UTC (1 container statuses recorded) I0119 22:17:20.522320 16 predicates.go:889] Container oidc-discovery-validator ready: false, restart count 0 [FAILED] in [BeforeEach] - k8s.io/kubernetes/test/e2e/scheduling/predicates.go:1164 @ 01/19/25 22:19:53.928 STEP: Remove fake resource and RuntimeClass @ 01/19/25 22:19:53.928 I0119 22:19:53.930711 16 helper.go:121] Waiting up to 7m0s for all (but 0) nodes to be ready STEP: dump namespace information after failure @ 01/19/25 22:19:53.934 STEP: Collecting events from namespace "sched-pred-2784". @ 01/19/25 22:19:53.934 STEP: Found 0 events. @ 01/19/25 22:19:53.937 I0119 22:19:53.938651 16 resource.go:168] POD NODE PHASE GRACE CONDITIONS I0119 22:19:53.938680 16 resource.go:178] I0119 22:19:53.941380 16 dump.go:109] Logging node info for node v130-control-plane I0119 22:19:53.943277 16 dump.go:114] Node Info: &Node{ObjectMeta:{v130-control-plane 73a26cf5-455a-49f0-9b47-9e2fe9ff1f70 55062 0 2025-01-19 16:27:29 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:v130-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2025-01-19 16:27:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2025-01-19 16:27:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2025-01-19 16:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2025-01-19 22:16:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/v130/v130-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-01-19 22:16:20 +0000 UTC,LastTransitionTime:2025-01-19 16:27:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-01-19 22:16:20 +0000 UTC,LastTransitionTime:2025-01-19 16:27:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-01-19 22:16:20 +0000 UTC,LastTransitionTime:2025-01-19 16:27:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-01-19 22:16:20 +0000 UTC,LastTransitionTime:2025-01-19 16:28:03 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.24.0.7,},NodeAddress{Type:Hostname,Address:v130-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5e56526adb514b2db9df6a5f0cd18ba9,SystemUUID:c8c6264f-20bf-4d81-aa38-fcf2013e122c,BootID:d52356e5-71e5-4116-b104-65900319af7a,KernelVersion:5.15.0-53-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://1.7.24,KubeletVersion:v1.30.8,KubeProxyVersion:v1.30.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:b5d7ff37179c1f36f5a0201d3d3a7d33c3a5f274f6c630a4aa99501e31483a7b registry.k8s.io/kube-apiserver-amd64:v1.30.8 registry.k8s.io/kube-apiserver:v1.30.8],SizeBytes:89472999,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:769d7b09cac626d2b597dd4fecf121d0ebf97d7717931cd29af6b276e5930080 registry.k8s.io/kube-proxy-amd64:v1.30.8 registry.k8s.io/kube-proxy:v1.30.8],SizeBytes:86002872,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:49ab9f4bf0a8570c85d6fecc8a392a21237f0c258405fc704a8af107e71131ce registry.k8s.io/kube-controller-manager-amd64:v1.30.8 registry.k8s.io/kube-controller-manager:v1.30.8],SizeBytes:83529534,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:3557d9cf812f95db4b9f2e00ce50985b9dfd504b4c76965c377f05281f299fbf registry.k8s.io/kube-scheduler-amd64:v1.30.8 registry.k8s.io/kube-scheduler:v1.30.8],SizeBytes:63074110,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.15-0],SizeBytes:56909194,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20241212-9f82dd49],SizeBytes:39008320,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20241212-8ac705d0],SizeBytes:22541737,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.11.3],SizeBytes:18562039,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},ContainerImage{Names:[docker.io/library/alpine@sha256:66790a2b79e1ea3e1dabac43990c54aca5d1ddf268d9a5a0285e4167c8b24475 docker.io/library/alpine:3.6],SizeBytes:2021226,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.10],SizeBytes:320368,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{},},} I0119 22:19:53.943294 16 dump.go:116] Logging kubelet events for node v130-control-plane I0119 22:19:53.944866 16 dump.go:121] Logging pods the kubelet thinks is on node v130-control-plane I0119 22:19:53.951812 16 dump.go:128] kube-scheduler-v130-control-plane started at 2025-01-19 16:27:33 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.951832 16 dump.go:134] Container kube-scheduler ready: true, restart count 0 I0119 22:19:53.951843 16 dump.go:128] kube-proxy-pd74p started at 2025-01-19 16:27:47 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.951852 16 dump.go:134] Container kube-proxy ready: true, restart count 0 I0119 22:19:53.951863 16 dump.go:128] coredns-55cb58b774-bqzd8 started at 2025-01-19 16:28:03 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.951873 16 dump.go:134] Container coredns ready: true, restart count 0 I0119 22:19:53.951883 16 dump.go:128] coredns-55cb58b774-25czd started at 2025-01-19 16:28:03 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.951891 16 dump.go:134] Container coredns ready: true, restart count 0 I0119 22:19:53.951901 16 dump.go:128] local-path-provisioner-5b8547b897-snlth started at 2025-01-19 16:28:03 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.951909 16 dump.go:134] Container local-path-provisioner ready: true, restart count 0 I0119 22:19:53.951918 16 dump.go:128] etcd-v130-control-plane started at 2025-01-19 16:27:33 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.951927 16 dump.go:134] Container etcd ready: true, restart count 0 I0119 22:19:53.951936 16 dump.go:128] kube-apiserver-v130-control-plane started at 2025-01-19 16:27:33 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.951944 16 dump.go:134] Container kube-apiserver ready: true, restart count 0 I0119 22:19:53.951955 16 dump.go:128] kube-controller-manager-v130-control-plane started at 2025-01-19 16:27:33 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.951962 16 dump.go:134] Container kube-controller-manager ready: true, restart count 0 I0119 22:19:53.951972 16 dump.go:128] kindnet-g5r8d started at 2025-01-19 16:27:47 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.951982 16 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0119 22:19:53.951992 16 dump.go:128] create-loop-devs-tk8kt started at 2025-01-19 16:27:54 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.952000 16 dump.go:134] Container loopdev ready: true, restart count 0 I0119 22:19:53.981066 16 kubelet_metrics.go:206] Latency metrics for node v130-control-plane I0119 22:19:53.981091 16 dump.go:109] Logging node info for node v130-worker I0119 22:19:53.983149 16 dump.go:114] Node Info: &Node{ObjectMeta:{v130-worker ab31affd-7b43-4fae-9dc3-8387731e7091 66131 0 2025-01-19 16:27:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/e2e-8e8b898c-5173-497c-b9d6-a22f69cbce52:95 kubernetes.io/hostname:v130-worker kubernetes.io/os:linux topology.hostpath.csi/node:v130-worker] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-8909":"csi-mock-csi-mock-volumes-expansion-8909","csi-mock-csi-mock-volumes-workload-830":"v130-worker"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2025-01-19 16:27:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubeadm Update v1 2025-01-19 16:27:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-01-19 16:27:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2025-01-19 22:16:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/e2e-8e8b898c-5173-497c-b9d6-a22f69cbce52":{}}}} } {kubelet Update v1 2025-01-19 22:19:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/v130/v130-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-01-19 22:19:52 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-01-19 22:19:52 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-01-19 22:19:52 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-01-19 22:19:52 +0000 UTC,LastTransitionTime:2025-01-19 16:28:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.24.0.6,},NodeAddress{Type:Hostname,Address:v130-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9caea890c1c645a1b09693fceb3df68d,SystemUUID:07a88b6a-9803-4060-bb3a-07e04aabba3b,BootID:d52356e5-71e5-4116-b104-65900319af7a,KernelVersion:5.15.0-53-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://1.7.24,KubeletVersion:v1.30.8,KubeProxyVersion:v1.30.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:b5d7ff37179c1f36f5a0201d3d3a7d33c3a5f274f6c630a4aa99501e31483a7b registry.k8s.io/kube-apiserver-amd64:v1.30.8 registry.k8s.io/kube-apiserver:v1.30.8],SizeBytes:89472999,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:769d7b09cac626d2b597dd4fecf121d0ebf97d7717931cd29af6b276e5930080 registry.k8s.io/kube-proxy-amd64:v1.30.8 registry.k8s.io/kube-proxy:v1.30.8],SizeBytes:86002872,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:49ab9f4bf0a8570c85d6fecc8a392a21237f0c258405fc704a8af107e71131ce registry.k8s.io/kube-controller-manager-amd64:v1.30.8 registry.k8s.io/kube-controller-manager:v1.30.8],SizeBytes:83529534,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:3557d9cf812f95db4b9f2e00ce50985b9dfd504b4c76965c377f05281f299fbf registry.k8s.io/kube-scheduler-amd64:v1.30.8 registry.k8s.io/kube-scheduler:v1.30.8],SizeBytes:63074110,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:44a8e24dcbba3470ee1fee21d5e88d128c936e9b55d4bc51fbef8086f8ed123b registry.k8s.io/etcd:3.5.12-0],SizeBytes:57236178,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.15-0],SizeBytes:56909194,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:cc249acbd34692826b2b335335615e060fdb3c0bca4954507aa3a1d1194de253 registry.k8s.io/e2e-test-images/agnhost:2.47],SizeBytes:52529911,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:19d4ecf1e0731b9ea55aca9c070d520f68b96ed0defbcc0e4eefe97b3d663ca3 registry.k8s.io/e2e-test-images/sample-apiserver:1.29.2],SizeBytes:39672997,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20241212-9f82dd49],SizeBytes:39008320,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:de79c8bbc271622eb94d2ee8689f189ea7c1cb6adac260a421980fe5eed66708 registry.k8s.io/sig-storage/csi-provisioner:v4.0.0],SizeBytes:29284608,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:4c148bbdf883153bc72d321be4dc55c33774a6d98b2b3e0c2da6ae389149a9b7 registry.k8s.io/sig-storage/csi-resizer:v1.10.0],SizeBytes:28038986,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:d69cc72025f7c40dae112ff989e920a3331583497c8dfb1600c5ae0e37184a29 registry.k8s.io/sig-storage/csi-attacher:v4.5.0],SizeBytes:27359336,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20241212-8ac705d0],SizeBytes:22541737,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.11.3],SizeBytes:18562039,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:49229a931e49d84454f34bd6aec9947018eacedee6fbbd8e0fc1b2aef24033c4 registry.k8s.io/sig-storage/hostpathplugin:v1.13.0],SizeBytes:17585300,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:60b89953ccfc57b9774a2da7455578c712174cbdd144b84d08657e63583041ad registry.k8s.io/build-image/distroless-iptables:v0.5.6],SizeBytes:11491940,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:c53535af8a7f7e3164609838c4b191b42b2d81238d75c1b2a2b582ada62a9780 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.0],SizeBytes:10897000,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:a9155b13325b2abef48e71de77bb8ac015412a566829f621d06bfae5c699b1b9 registry.k8s.io/e2e-test-images/busybox:1.36.1-1],SizeBytes:2223659,},ContainerImage{Names:[docker.io/library/alpine@sha256:66790a2b79e1ea3e1dabac43990c54aca5d1ddf268d9a5a0285e4167c8b24475 docker.io/library/alpine:3.6],SizeBytes:2021226,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 docker.io/library/busybox:1.28],SizeBytes:727869,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.10],SizeBytes:320368,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:299480,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{},},} I0119 22:19:53.983170 16 dump.go:116] Logging kubelet events for node v130-worker I0119 22:19:53.984605 16 dump.go:121] Logging pods the kubelet thinks is on node v130-worker I0119 22:19:53.998027 16 dump.go:128] busybox-dbf18385-5abb-42ce-b999-ab2e02652a14 started at 2025-01-19 22:15:27 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998043 16 dump.go:134] Container busybox ready: true, restart count 0 I0119 22:19:53.998054 16 dump.go:128] csi-mockplugin-0 started at 2025-01-19 22:17:23 +0000 UTC (0+4 container statuses recorded) I0119 22:19:53.998062 16 dump.go:134] Container busybox ready: true, restart count 0 I0119 22:19:53.998070 16 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0119 22:19:53.998077 16 dump.go:134] Container driver-registrar ready: true, restart count 0 I0119 22:19:53.998086 16 dump.go:134] Container mock ready: true, restart count 0 I0119 22:19:53.998096 16 dump.go:128] csi-mockplugin-0 started at 2025-01-19 22:18:15 +0000 UTC (0+4 container statuses recorded) I0119 22:19:53.998104 16 dump.go:134] Container busybox ready: true, restart count 0 I0119 22:19:53.998110 16 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0119 22:19:53.998117 16 dump.go:134] Container driver-registrar ready: true, restart count 0 I0119 22:19:53.998123 16 dump.go:134] Container mock ready: true, restart count 0 I0119 22:19:53.998131 16 dump.go:128] pod-terminate-status-1-10 started at 2025-01-19 22:19:51 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998139 16 dump.go:134] Container fail ready: false, restart count 0 I0119 22:19:53.998147 16 dump.go:128] pod-terminate-status-0-11 started at 2025-01-19 22:19:50 +0000 UTC (1+1 container statuses recorded) I0119 22:19:53.998155 16 dump.go:130] Init container fail ready: false, restart count 0 I0119 22:19:53.998164 16 dump.go:134] Container blocked ready: false, restart count 0 I0119 22:19:53.998171 16 dump.go:128] pod4 started at 2025-01-19 22:16:23 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998178 16 dump.go:134] Container agnhost ready: true, restart count 0 I0119 22:19:53.998187 16 dump.go:128] pod-terminate-status-2-10 started at 2025-01-19 22:19:51 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998194 16 dump.go:134] Container fail ready: false, restart count 0 I0119 22:19:53.998202 16 dump.go:128] startup-dbf754d2-c9b9-44b2-94a9-09e4d7f1c17b started at 2025-01-19 22:17:54 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998209 16 dump.go:134] Container busybox ready: false, restart count 0 I0119 22:19:53.998218 16 dump.go:128] pause-pod-0 started at 2025-01-19 22:19:42 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998226 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:19:53.998234 16 dump.go:128] pause-pod-1 started at 2025-01-19 22:18:49 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998242 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:19:53.998249 16 dump.go:128] csi-mockplugin-attacher-0 started at 2025-01-19 22:17:57 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998257 16 dump.go:134] Container csi-attacher ready: true, restart count 0 I0119 22:19:53.998266 16 dump.go:128] pod1-handle-http-request started at 2025-01-19 22:19:37 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998273 16 dump.go:134] Container container-handle-8090-request ready: true, restart count 0 I0119 22:19:53.998281 16 dump.go:128] back-off-cap started at 2025-01-19 22:12:36 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998289 16 dump.go:134] Container back-off-cap ready: false, restart count 6 I0119 22:19:53.998297 16 dump.go:128] e2e-net-exec started at 2025-01-19 22:18:02 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998304 16 dump.go:134] Container e2e-net-exec ready: false, restart count 0 I0119 22:19:53.998312 16 dump.go:128] csi-mockplugin-resizer-0 started at 2025-01-19 22:18:15 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998320 16 dump.go:134] Container csi-resizer ready: true, restart count 0 I0119 22:19:53.998328 16 dump.go:128] kube-proxy-4tgfc started at 2025-01-19 16:27:53 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998336 16 dump.go:134] Container kube-proxy ready: true, restart count 0 I0119 22:19:53.998344 16 dump.go:128] ss-1 started at 2025-01-19 22:18:39 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998352 16 dump.go:134] Container webserver ready: true, restart count 0 I0119 22:19:53.998361 16 dump.go:128] netserver-0 started at 2025-01-19 22:19:11 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998367 16 dump.go:134] Container webserver ready: false, restart count 0 I0119 22:19:53.998375 16 dump.go:128] csi-mockplugin-0 started at 2025-01-19 22:17:57 +0000 UTC (0+3 container statuses recorded) I0119 22:19:53.998382 16 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0119 22:19:53.998390 16 dump.go:134] Container driver-registrar ready: true, restart count 0 I0119 22:19:53.998398 16 dump.go:134] Container mock ready: true, restart count 0 I0119 22:19:53.998406 16 dump.go:128] ss2-2 started at 2025-01-19 22:19:43 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998414 16 dump.go:134] Container webserver ready: true, restart count 0 I0119 22:19:53.998422 16 dump.go:128] pause-pod-0 started at 2025-01-19 22:19:50 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998430 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:19:53.998438 16 dump.go:128] pod2-handle-http-request started at 2025-01-19 22:19:52 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998446 16 dump.go:134] Container container-handle-8090-request ready: false, restart count 0 I0119 22:19:53.998454 16 dump.go:128] webserver-pod started at 2025-01-19 22:15:55 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998461 16 dump.go:134] Container agnhost ready: false, restart count 0 I0119 22:19:53.998470 16 dump.go:128] create-loop-devs-ltqc4 started at 2025-01-19 16:27:54 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998478 16 dump.go:134] Container loopdev ready: true, restart count 0 I0119 22:19:53.998486 16 dump.go:128] pod-client started at 2025-01-19 22:19:01 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998493 16 dump.go:134] Container pod-client ready: false, restart count 1 I0119 22:19:53.998501 16 dump.go:128] netserver-0 started at 2025-01-19 22:18:37 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998508 16 dump.go:134] Container webserver ready: true, restart count 0 I0119 22:19:53.998517 16 dump.go:128] ss-0 started at 2025-01-19 22:19:43 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998524 16 dump.go:134] Container webserver ready: true, restart count 0 I0119 22:19:53.998532 16 dump.go:128] echo-hostname-0 started at 2025-01-19 22:18:16 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998539 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:19:53.998546 16 dump.go:128] ss-0 started at 2025-01-19 22:18:22 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998554 16 dump.go:134] Container webserver ready: true, restart count 0 I0119 22:19:53.998562 16 dump.go:128] kindnet-l85ml started at 2025-01-19 16:27:53 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998569 16 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0119 22:19:53.998577 16 dump.go:128] csi-mockplugin-attacher-0 started at 2025-01-19 22:18:15 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998584 16 dump.go:134] Container csi-attacher ready: true, restart count 0 I0119 22:19:53.998592 16 dump.go:128] echo-hostname-0 started at 2025-01-19 22:19:38 +0000 UTC (0+1 container statuses recorded) I0119 22:19:53.998599 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:19:55.769331 16 kubelet_metrics.go:206] Latency metrics for node v130-worker I0119 22:19:55.769360 16 dump.go:109] Logging node info for node v130-worker2 I0119 22:19:55.771945 16 dump.go:114] Node Info: &Node{ObjectMeta:{v130-worker2 959a09b5-5056-4366-9f6f-50907c6fd0eb 65403 0 2025-01-19 16:27:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:v130-worker2 kubernetes.io/os:linux topology.hostpath.csi/node:v130-worker2] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-fsgroup-policy-667":"v130-worker2"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2025-01-19 16:27:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubelet Update v1 2025-01-19 16:27:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2025-01-19 16:27:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-01-19 22:19:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/v130/v130-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-01-19 22:18:25 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-01-19 22:18:25 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-01-19 22:18:25 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-01-19 22:18:25 +0000 UTC,LastTransitionTime:2025-01-19 16:28:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.24.0.5,},NodeAddress{Type:Hostname,Address:v130-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3d7c7e6b4d3945dc9fa4369e127db629,SystemUUID:6097a547-bbca-4d71-857e-d96b4c4c9155,BootID:d52356e5-71e5-4116-b104-65900319af7a,KernelVersion:5.15.0-53-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://1.7.24,KubeletVersion:v1.30.8,KubeProxyVersion:v1.30.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:b5d7ff37179c1f36f5a0201d3d3a7d33c3a5f274f6c630a4aa99501e31483a7b registry.k8s.io/kube-apiserver-amd64:v1.30.8 registry.k8s.io/kube-apiserver:v1.30.8],SizeBytes:89472999,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:769d7b09cac626d2b597dd4fecf121d0ebf97d7717931cd29af6b276e5930080 registry.k8s.io/kube-proxy-amd64:v1.30.8 registry.k8s.io/kube-proxy:v1.30.8],SizeBytes:86002872,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:49ab9f4bf0a8570c85d6fecc8a392a21237f0c258405fc704a8af107e71131ce registry.k8s.io/kube-controller-manager-amd64:v1.30.8 registry.k8s.io/kube-controller-manager:v1.30.8],SizeBytes:83529534,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:3557d9cf812f95db4b9f2e00ce50985b9dfd504b4c76965c377f05281f299fbf registry.k8s.io/kube-scheduler-amd64:v1.30.8 registry.k8s.io/kube-scheduler:v1.30.8],SizeBytes:63074110,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.15-0],SizeBytes:56909194,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:cc249acbd34692826b2b335335615e060fdb3c0bca4954507aa3a1d1194de253 registry.k8s.io/e2e-test-images/agnhost:2.47],SizeBytes:52529911,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20241212-9f82dd49],SizeBytes:39008320,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:de79c8bbc271622eb94d2ee8689f189ea7c1cb6adac260a421980fe5eed66708 registry.k8s.io/sig-storage/csi-provisioner:v4.0.0],SizeBytes:29284608,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20241212-8ac705d0],SizeBytes:22541737,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.11.3],SizeBytes:18562039,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:49229a931e49d84454f34bd6aec9947018eacedee6fbbd8e0fc1b2aef24033c4 registry.k8s.io/sig-storage/hostpathplugin:v1.13.0],SizeBytes:17585300,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:c53535af8a7f7e3164609838c4b191b42b2d81238d75c1b2a2b582ada62a9780 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.0],SizeBytes:10897000,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:a9155b13325b2abef48e71de77bb8ac015412a566829f621d06bfae5c699b1b9 registry.k8s.io/e2e-test-images/busybox:1.36.1-1],SizeBytes:2223659,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[docker.io/library/alpine@sha256:66790a2b79e1ea3e1dabac43990c54aca5d1ddf268d9a5a0285e4167c8b24475 docker.io/library/alpine:3.6],SizeBytes:2021226,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 docker.io/library/busybox:1.28],SizeBytes:727869,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.10],SizeBytes:320368,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:299480,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{},},} I0119 22:19:55.771968 16 dump.go:116] Logging kubelet events for node v130-worker2 I0119 22:19:55.773568 16 dump.go:121] Logging pods the kubelet thinks is on node v130-worker2 I0119 22:19:55.790434 16 dump.go:128] pvc-volume-tester-5nj4b started at 2025-01-19 22:18:55 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790461 16 dump.go:134] Container volume-tester ready: true, restart count 0 I0119 22:19:55.790472 16 dump.go:128] inclusterclient started at 2025-01-19 22:10:37 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790481 16 dump.go:134] Container inclusterclient ready: true, restart count 0 I0119 22:19:55.790491 16 dump.go:128] hostexec-v130-worker2-87qtf started at 2025-01-19 22:19:53 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790505 16 dump.go:134] Container agnhost-container ready: false, restart count 0 I0119 22:19:55.790515 16 dump.go:128] pod-projected-configmaps-3c2b058b-1db7-4385-8fff-da19b120dccc started at 2025-01-19 22:19:21 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790523 16 dump.go:134] Container agnhost-container ready: false, restart count 0 I0119 22:19:55.790532 16 dump.go:128] pod-handle-http-request started at 2025-01-19 22:18:50 +0000 UTC (0+2 container statuses recorded) I0119 22:19:55.790540 16 dump.go:134] Container container-handle-8090-request ready: true, restart count 0 I0119 22:19:55.790549 16 dump.go:134] Container container-handle-9090-request ready: true, restart count 0 I0119 22:19:55.790558 16 dump.go:128] csi-mockplugin-0 started at 2025-01-19 22:17:23 +0000 UTC (0+3 container statuses recorded) I0119 22:19:55.790566 16 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0119 22:19:55.790575 16 dump.go:134] Container driver-registrar ready: true, restart count 0 I0119 22:19:55.790583 16 dump.go:134] Container mock ready: true, restart count 0 I0119 22:19:55.790592 16 dump.go:128] pod-secrets-e0b5f9a4-0915-434c-bc6f-15db0a0903be started at 2025-01-19 22:17:23 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790600 16 dump.go:134] Container creates-volume-test ready: false, restart count 0 I0119 22:19:55.790609 16 dump.go:128] pod-terminate-status-0-10 started at 2025-01-19 22:19:51 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790618 16 dump.go:134] Container fail ready: false, restart count 0 I0119 22:19:55.790632 16 dump.go:128] helper-pod-delete-pvc-045e3f1c-bd6c-4927-8a11-1496ac252e49 started at 2025-01-19 22:19:53 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790644 16 dump.go:134] Container helper-pod ready: false, restart count 0 I0119 22:19:55.790660 16 dump.go:128] hostexec-v130-worker2-k2rdr started at 2025-01-19 22:18:49 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790673 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:19:55.790688 16 dump.go:128] kube-proxy-bfxlq started at 2025-01-19 16:27:53 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790701 16 dump.go:134] Container kube-proxy ready: true, restart count 0 I0119 22:19:55.790716 16 dump.go:128] test-container-pod started at 2025-01-19 22:19:03 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790730 16 dump.go:134] Container webserver ready: true, restart count 0 I0119 22:19:55.790746 16 dump.go:128] pod-terminate-status-1-8 started at 2025-01-19 22:19:17 +0000 UTC (1+1 container statuses recorded) I0119 22:19:55.790761 16 dump.go:130] Init container fail ready: false, restart count 0 I0119 22:19:55.790777 16 dump.go:134] Container blocked ready: false, restart count 0 I0119 22:19:55.790847 16 dump.go:128] pod-server-1 started at 2025-01-19 22:19:37 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790864 16 dump.go:134] Container agnhost-container ready: false, restart count 0 I0119 22:19:55.790877 16 dump.go:128] pause-pod-1 started at 2025-01-19 22:19:54 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790891 16 dump.go:134] Container agnhost-container ready: false, restart count 0 I0119 22:19:55.790907 16 dump.go:128] netserver-1 started at 2025-01-19 22:19:11 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790921 16 dump.go:134] Container webserver ready: false, restart count 0 I0119 22:19:55.790937 16 dump.go:128] pod-secrets-6cc63280-919d-4231-b644-a0f66f327d72 started at 2025-01-19 22:19:48 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790951 16 dump.go:134] Container secret-env-test ready: false, restart count 0 I0119 22:19:55.790967 16 dump.go:128] pod-secrets-5f3a5818-fac8-4e3d-a967-9247e0923017 started at 2025-01-19 22:17:43 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.790981 16 dump.go:134] Container creates-volume-test ready: false, restart count 0 I0119 22:19:55.790995 16 dump.go:128] csi-mockplugin-0 started at 2025-01-19 22:19:53 +0000 UTC (0+4 container statuses recorded) I0119 22:19:55.791009 16 dump.go:134] Container busybox ready: false, restart count 0 I0119 22:19:55.791025 16 dump.go:134] Container csi-provisioner ready: false, restart count 0 I0119 22:19:55.791039 16 dump.go:134] Container driver-registrar ready: false, restart count 0 I0119 22:19:55.791052 16 dump.go:134] Container mock ready: false, restart count 0 I0119 22:19:55.791069 16 dump.go:128] svc-latency-rc-m7k8f started at 2025-01-19 22:19:25 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791081 16 dump.go:134] Container svc-latency-rc ready: false, restart count 0 I0119 22:19:55.791099 16 dump.go:128] ss2-0 started at 2025-01-19 22:18:36 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791114 16 dump.go:134] Container webserver ready: true, restart count 0 I0119 22:19:55.791127 16 dump.go:128] execpodrmsf2 started at 2025-01-19 22:19:37 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791142 16 dump.go:134] Container agnhost-container ready: false, restart count 0 I0119 22:19:55.791157 16 dump.go:128] test-hostpath-type-kjxp4 started at 2025-01-19 22:17:56 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791171 16 dump.go:134] Container host-path-sh-testing ready: false, restart count 0 I0119 22:19:55.791187 16 dump.go:128] kindnet-vwh7p started at 2025-01-19 16:27:53 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791201 16 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0119 22:19:55.791218 16 dump.go:128] csi-mockplugin-0 started at 2025-01-19 22:17:23 +0000 UTC (0+4 container statuses recorded) I0119 22:19:55.791233 16 dump.go:134] Container busybox ready: true, restart count 0 I0119 22:19:55.791247 16 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0119 22:19:55.791262 16 dump.go:134] Container driver-registrar ready: true, restart count 0 I0119 22:19:55.791276 16 dump.go:134] Container mock ready: true, restart count 0 I0119 22:19:55.791290 16 dump.go:128] webserver-pod started at 2025-01-19 22:18:26 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791303 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:19:55.791319 16 dump.go:128] test-grpc-a7b18fe1-ff99-47a7-bae2-7f9aa0c329e8 started at 2025-01-19 22:17:33 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791333 16 dump.go:134] Container agnhost ready: true, restart count 0 I0119 22:19:55.791351 16 dump.go:128] pod-projected-configmaps-c0f918ce-5e1d-4093-b1f8-07e6925988c0 started at 2025-01-19 22:19:18 +0000 UTC (0+3 container statuses recorded) I0119 22:19:55.791365 16 dump.go:134] Container createcm-volume-test ready: false, restart count 0 I0119 22:19:55.791375 16 dump.go:134] Container delcm-volume-test ready: false, restart count 0 I0119 22:19:55.791383 16 dump.go:134] Container updcm-volume-test ready: false, restart count 0 I0119 22:19:55.791392 16 dump.go:128] ss-2 started at 2025-01-19 22:18:22 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791400 16 dump.go:134] Container webserver ready: false, restart count 0 I0119 22:19:55.791408 16 dump.go:128] netserver-1 started at 2025-01-19 22:18:37 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791415 16 dump.go:134] Container webserver ready: true, restart count 0 I0119 22:19:55.791424 16 dump.go:128] sample-webhook-deployment-6b869959d-bmwfb started at 2025-01-19 22:19:51 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791431 16 dump.go:134] Container sample-webhook ready: false, restart count 0 I0119 22:19:55.791440 16 dump.go:128] funny-ip-djfs8 started at 2025-01-19 22:18:52 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791448 16 dump.go:134] Container funny-ip ready: true, restart count 0 I0119 22:19:55.791457 16 dump.go:128] downwardapi-volume-3fbc4d56-065d-4e4c-a514-487935a02e9e started at 2025-01-19 22:19:38 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791464 16 dump.go:134] Container client-container ready: false, restart count 0 I0119 22:19:55.791475 16 dump.go:128] pod-back-off-image started at 2025-01-19 22:17:32 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791486 16 dump.go:134] Container back-off ready: true, restart count 4 I0119 22:19:55.791497 16 dump.go:128] downwardapi-volume-954aee92-352d-43e7-88d7-5f4e1f1c7fcb started at 2025-01-19 22:19:51 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791504 16 dump.go:134] Container client-container ready: false, restart count 0 I0119 22:19:55.791513 16 dump.go:128] create-loop-devs-zk7ps started at 2025-01-19 16:27:54 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791519 16 dump.go:134] Container loopdev ready: true, restart count 0 I0119 22:19:55.791528 16 dump.go:128] pod-update-45f41539-807d-4ce1-9fa8-a369c01e9b6a started at 2025-01-19 22:18:55 +0000 UTC (0+1 container statuses recorded) I0119 22:19:55.791535 16 dump.go:134] Container pause ready: true, restart count 0 I0119 22:19:55.791544 16 dump.go:128] pod-terminate-status-2-14 started at 2025-01-19 22:19:42 +0000 UTC (1+1 container statuses recorded) I0119 22:19:55.791553 16 dump.go:130] Init container fail ready: false, restart count 0 I0119 22:19:55.791567 16 dump.go:134] Container blocked ready: false, restart count 0 I0119 22:20:01.957725 16 kubelet_metrics.go:206] Latency metrics for node v130-worker2 STEP: Destroying namespace "sched-pred-2784" for this suite. @ 01/19/25 22:20:01.957 << Timeline [FAILED] Did not find 'scheduled' condition for pod pfpod In [BeforeEach] at: k8s.io/kubernetes/test/e2e/scheduling/predicates.go:1164 @ 01/19/25 22:19:53.928 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [FAILED] [70.548 seconds] [sig-scheduling] SchedulerPreemption [Serial] PodTopologySpread Preemption [It] validates proper pods are preempted [sig-scheduling, Serial] k8s.io/kubernetes/test/e2e/scheduling/preemption.go:434 Timeline >> STEP: Creating a kubernetes client @ 01/19/25 22:22:43.831 I0119 22:22:43.831256 16 util.go:506] >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename sched-preemption @ 01/19/25 22:22:43.832 STEP: Waiting for a default service account to be provisioned in namespace @ 01/19/25 22:22:43.841 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace @ 01/19/25 22:22:43.843 I0119 22:22:43.852716 16 wait.go:50] Waiting up to 1m0s for all nodes to be ready I0119 22:23:43.856764 16 util.go:400] Waiting for terminating namespaces to be deleted... STEP: Trying to get 2 available nodes which can run pod @ 01/19/25 22:23:43.86 STEP: Trying to launch a pod without a label to get a node which can launch it. @ 01/19/25 22:23:43.86 STEP: Explicitly delete pod here to free the resource it takes. @ 01/19/25 22:23:45.871 STEP: Trying to launch a pod without a label to get a node which can launch it. @ 01/19/25 22:23:45.876 STEP: Explicitly delete pod here to free the resource it takes. @ 01/19/25 22:23:47.885 STEP: Apply dedicated topologyKey kubernetes.io/e2e-pts-preemption for this test on the 2 nodes. @ 01/19/25 22:23:47.892 STEP: Apply 10 fake resource to node v130-worker. @ 01/19/25 22:23:47.908 STEP: Apply 10 fake resource to node v130-worker2. @ 01/19/25 22:23:47.927 STEP: Create 1 High Pod and 3 Low Pods to occupy 9/10 of fake resources on both nodes. @ 01/19/25 22:23:47.934 I0119 22:23:53.964824 16 predicates.go:952] Unexpected error: <*errors.StatusError | 0xc0022c9d60>: pods "low-3" is forbidden: no PriorityClass with name sched-preemption-low-priority was found { ErrStatus: code: 403 details: kind: pods name: low-3 message: 'pods "low-3" is forbidden: no PriorityClass with name sched-preemption-low-priority was found' metadata: {} reason: Forbidden status: Failure, } [FAILED] in [It] - k8s.io/kubernetes/test/e2e/scheduling/predicates.go:952 @ 01/19/25 22:23:53.965 STEP: removing the label kubernetes.io/e2e-pts-preemption off the node v130-worker @ 01/19/25 22:23:53.965 STEP: verifying the node doesn't have the label kubernetes.io/e2e-pts-preemption @ 01/19/25 22:23:53.979 STEP: removing the label kubernetes.io/e2e-pts-preemption off the node v130-worker2 @ 01/19/25 22:23:53.981 STEP: verifying the node doesn't have the label kubernetes.io/e2e-pts-preemption @ 01/19/25 22:23:53.988 I0119 22:23:54.021277 16 helper.go:121] Waiting up to 7m0s for all (but 0) nodes to be ready STEP: dump namespace information after failure @ 01/19/25 22:23:54.023 STEP: Collecting events from namespace "sched-preemption-6373". @ 01/19/25 22:23:54.023 STEP: Found 22 events. @ 01/19/25 22:23:54.025 I0119 22:23:54.025426 16 dump.go:53] At 2025-01-19 22:23:43 +0000 UTC - event for without-label: {default-scheduler } Scheduled: Successfully assigned sched-preemption-6373/without-label to v130-worker I0119 22:23:54.025458 16 dump.go:53] At 2025-01-19 22:23:44 +0000 UTC - event for without-label: {kubelet v130-worker} Created: Created container without-label I0119 22:23:54.025471 16 dump.go:53] At 2025-01-19 22:23:44 +0000 UTC - event for without-label: {kubelet v130-worker} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine I0119 22:23:54.025480 16 dump.go:53] At 2025-01-19 22:23:44 +0000 UTC - event for without-label: {kubelet v130-worker} Started: Started container without-label I0119 22:23:54.025489 16 dump.go:53] At 2025-01-19 22:23:45 +0000 UTC - event for without-label: {default-scheduler } Scheduled: Successfully assigned sched-preemption-6373/without-label to v130-worker2 I0119 22:23:54.025498 16 dump.go:53] At 2025-01-19 22:23:45 +0000 UTC - event for without-label: {kubelet v130-worker} Killing: Stopping container without-label I0119 22:23:54.025507 16 dump.go:53] At 2025-01-19 22:23:46 +0000 UTC - event for without-label: {kubelet v130-worker2} Started: Started container without-label I0119 22:23:54.025515 16 dump.go:53] At 2025-01-19 22:23:46 +0000 UTC - event for without-label: {kubelet v130-worker2} Created: Created container without-label I0119 22:23:54.025523 16 dump.go:53] At 2025-01-19 22:23:46 +0000 UTC - event for without-label: {kubelet v130-worker2} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine I0119 22:23:54.025531 16 dump.go:53] At 2025-01-19 22:23:47 +0000 UTC - event for high: {default-scheduler } Scheduled: Successfully assigned sched-preemption-6373/high to v130-worker2 I0119 22:23:54.025539 16 dump.go:53] At 2025-01-19 22:23:48 +0000 UTC - event for high: {kubelet v130-worker2} Started: Started container high I0119 22:23:54.025547 16 dump.go:53] At 2025-01-19 22:23:48 +0000 UTC - event for high: {kubelet v130-worker2} Created: Created container high I0119 22:23:54.025560 16 dump.go:53] At 2025-01-19 22:23:48 +0000 UTC - event for high: {kubelet v130-worker2} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine I0119 22:23:54.025578 16 dump.go:53] At 2025-01-19 22:23:48 +0000 UTC - event for without-label: {kubelet v130-worker2} Killing: Stopping container without-label I0119 22:23:54.025594 16 dump.go:53] At 2025-01-19 22:23:49 +0000 UTC - event for low-1: {default-scheduler } Scheduled: Successfully assigned sched-preemption-6373/low-1 to v130-worker I0119 22:23:54.025607 16 dump.go:53] At 2025-01-19 22:23:50 +0000 UTC - event for low-1: {kubelet v130-worker} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine I0119 22:23:54.025615 16 dump.go:53] At 2025-01-19 22:23:50 +0000 UTC - event for low-1: {kubelet v130-worker} Created: Created container low-1 I0119 22:23:54.025624 16 dump.go:53] At 2025-01-19 22:23:51 +0000 UTC - event for low-1: {kubelet v130-worker} Started: Started container low-1 I0119 22:23:54.025633 16 dump.go:53] At 2025-01-19 22:23:51 +0000 UTC - event for low-2: {default-scheduler } Scheduled: Successfully assigned sched-preemption-6373/low-2 to v130-worker I0119 22:23:54.025641 16 dump.go:53] At 2025-01-19 22:23:52 +0000 UTC - event for low-2: {kubelet v130-worker} Started: Started container low-2 I0119 22:23:54.025648 16 dump.go:53] At 2025-01-19 22:23:52 +0000 UTC - event for low-2: {kubelet v130-worker} Created: Created container low-2 I0119 22:23:54.025657 16 dump.go:53] At 2025-01-19 22:23:52 +0000 UTC - event for low-2: {kubelet v130-worker} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine I0119 22:23:54.027653 16 resource.go:168] POD NODE PHASE GRACE CONDITIONS I0119 22:23:54.027713 16 resource.go:175] high v130-worker2 Running [{PodReadyToStartContainers True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:49 +0000 UTC } {Initialized True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:47 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:49 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:49 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:47 +0000 UTC }] I0119 22:23:54.027737 16 resource.go:175] low-1 v130-worker Running [{PodReadyToStartContainers True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:51 +0000 UTC } {Initialized True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:49 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:51 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:51 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:49 +0000 UTC }] I0119 22:23:54.027759 16 resource.go:175] low-2 v130-worker Running [{PodReadyToStartContainers True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:53 +0000 UTC } {Initialized True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:51 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:53 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:53 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2025-01-19 22:23:51 +0000 UTC }] I0119 22:23:54.027766 16 resource.go:178] I0119 22:23:54.039053 16 dump.go:109] Logging node info for node v130-control-plane I0119 22:23:54.041043 16 dump.go:114] Node Info: &Node{ObjectMeta:{v130-control-plane 73a26cf5-455a-49f0-9b47-9e2fe9ff1f70 73510 0 2025-01-19 16:27:29 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:v130-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2025-01-19 16:27:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2025-01-19 16:27:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2025-01-19 16:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2025-01-19 22:21:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/v130/v130-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-01-19 22:21:26 +0000 UTC,LastTransitionTime:2025-01-19 16:27:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-01-19 22:21:26 +0000 UTC,LastTransitionTime:2025-01-19 16:27:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-01-19 22:21:26 +0000 UTC,LastTransitionTime:2025-01-19 16:27:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-01-19 22:21:26 +0000 UTC,LastTransitionTime:2025-01-19 16:28:03 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.24.0.7,},NodeAddress{Type:Hostname,Address:v130-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5e56526adb514b2db9df6a5f0cd18ba9,SystemUUID:c8c6264f-20bf-4d81-aa38-fcf2013e122c,BootID:d52356e5-71e5-4116-b104-65900319af7a,KernelVersion:5.15.0-53-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://1.7.24,KubeletVersion:v1.30.8,KubeProxyVersion:v1.30.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:b5d7ff37179c1f36f5a0201d3d3a7d33c3a5f274f6c630a4aa99501e31483a7b registry.k8s.io/kube-apiserver-amd64:v1.30.8 registry.k8s.io/kube-apiserver:v1.30.8],SizeBytes:89472999,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:769d7b09cac626d2b597dd4fecf121d0ebf97d7717931cd29af6b276e5930080 registry.k8s.io/kube-proxy-amd64:v1.30.8 registry.k8s.io/kube-proxy:v1.30.8],SizeBytes:86002872,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:49ab9f4bf0a8570c85d6fecc8a392a21237f0c258405fc704a8af107e71131ce registry.k8s.io/kube-controller-manager-amd64:v1.30.8 registry.k8s.io/kube-controller-manager:v1.30.8],SizeBytes:83529534,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:3557d9cf812f95db4b9f2e00ce50985b9dfd504b4c76965c377f05281f299fbf registry.k8s.io/kube-scheduler-amd64:v1.30.8 registry.k8s.io/kube-scheduler:v1.30.8],SizeBytes:63074110,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.15-0],SizeBytes:56909194,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20241212-9f82dd49],SizeBytes:39008320,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20241212-8ac705d0],SizeBytes:22541737,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.11.3],SizeBytes:18562039,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},ContainerImage{Names:[docker.io/library/alpine@sha256:66790a2b79e1ea3e1dabac43990c54aca5d1ddf268d9a5a0285e4167c8b24475 docker.io/library/alpine:3.6],SizeBytes:2021226,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.10],SizeBytes:320368,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{},},} I0119 22:23:54.041065 16 dump.go:116] Logging kubelet events for node v130-control-plane I0119 22:23:54.042717 16 dump.go:121] Logging pods the kubelet thinks is on node v130-control-plane I0119 22:23:54.058303 16 dump.go:128] kube-scheduler-v130-control-plane started at 2025-01-19 16:27:33 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.058369 16 dump.go:134] Container kube-scheduler ready: true, restart count 0 I0119 22:23:54.058389 16 dump.go:128] kube-proxy-pd74p started at 2025-01-19 16:27:47 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.058404 16 dump.go:134] Container kube-proxy ready: true, restart count 0 I0119 22:23:54.058429 16 dump.go:128] coredns-55cb58b774-bqzd8 started at 2025-01-19 16:28:03 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.058446 16 dump.go:134] Container coredns ready: true, restart count 0 I0119 22:23:54.058464 16 dump.go:128] create-loop-devs-tk8kt started at 2025-01-19 16:27:54 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.058484 16 dump.go:134] Container loopdev ready: true, restart count 0 I0119 22:23:54.058501 16 dump.go:128] coredns-55cb58b774-25czd started at 2025-01-19 16:28:03 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.058521 16 dump.go:134] Container coredns ready: true, restart count 0 I0119 22:23:54.058539 16 dump.go:128] local-path-provisioner-5b8547b897-snlth started at 2025-01-19 16:28:03 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.058552 16 dump.go:134] Container local-path-provisioner ready: true, restart count 0 I0119 22:23:54.058572 16 dump.go:128] etcd-v130-control-plane started at 2025-01-19 16:27:33 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.058594 16 dump.go:134] Container etcd ready: true, restart count 0 I0119 22:23:54.058611 16 dump.go:128] kube-apiserver-v130-control-plane started at 2025-01-19 16:27:33 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.058631 16 dump.go:134] Container kube-apiserver ready: true, restart count 0 I0119 22:23:54.058644 16 dump.go:128] kube-controller-manager-v130-control-plane started at 2025-01-19 16:27:33 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.058664 16 dump.go:134] Container kube-controller-manager ready: true, restart count 0 I0119 22:23:54.058942 16 dump.go:128] kindnet-g5r8d started at 2025-01-19 16:27:47 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.058983 16 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0119 22:23:54.093357 16 kubelet_metrics.go:206] Latency metrics for node v130-control-plane I0119 22:23:54.093385 16 dump.go:109] Logging node info for node v130-worker I0119 22:23:54.095708 16 dump.go:114] Node Info: &Node{ObjectMeta:{v130-worker ab31affd-7b43-4fae-9dc3-8387731e7091 85616 0 2025-01-19 16:27:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:v130-worker kubernetes.io/os:linux topology.hostpath.csi/node:v130-worker] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-2394":"v130-worker","csi-mock-csi-mock-volumes-expansion-8277":"v130-worker"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2025-01-19 16:27:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubeadm Update v1 2025-01-19 16:27:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-01-19 16:27:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2025-01-19 22:22:51 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2025-01-19 22:23:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2025-01-19 22:23:47 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:example.com/fakePTSRes":{}},"f:capacity":{"f:example.com/fakePTSRes":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/v130/v130-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},example.com/fakePTSRes: {{10 0} {} 10 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},example.com/fakePTSRes: {{10 0} {} 10 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-01-19 22:22:56 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-01-19 22:22:56 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-01-19 22:22:56 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-01-19 22:22:56 +0000 UTC,LastTransitionTime:2025-01-19 16:28:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.24.0.6,},NodeAddress{Type:Hostname,Address:v130-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9caea890c1c645a1b09693fceb3df68d,SystemUUID:07a88b6a-9803-4060-bb3a-07e04aabba3b,BootID:d52356e5-71e5-4116-b104-65900319af7a,KernelVersion:5.15.0-53-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://1.7.24,KubeletVersion:v1.30.8,KubeProxyVersion:v1.30.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:b5d7ff37179c1f36f5a0201d3d3a7d33c3a5f274f6c630a4aa99501e31483a7b registry.k8s.io/kube-apiserver-amd64:v1.30.8 registry.k8s.io/kube-apiserver:v1.30.8],SizeBytes:89472999,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:769d7b09cac626d2b597dd4fecf121d0ebf97d7717931cd29af6b276e5930080 registry.k8s.io/kube-proxy-amd64:v1.30.8 registry.k8s.io/kube-proxy:v1.30.8],SizeBytes:86002872,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:49ab9f4bf0a8570c85d6fecc8a392a21237f0c258405fc704a8af107e71131ce registry.k8s.io/kube-controller-manager-amd64:v1.30.8 registry.k8s.io/kube-controller-manager:v1.30.8],SizeBytes:83529534,},ContainerImage{Names:[docker.io/library/nginx@sha256:0a399eb16751829e1af26fea27b20c3ec28d7ab1fb72182879dcae1cca21206a docker.io/library/nginx:latest],SizeBytes:72080558,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:3557d9cf812f95db4b9f2e00ce50985b9dfd504b4c76965c377f05281f299fbf registry.k8s.io/kube-scheduler-amd64:v1.30.8 registry.k8s.io/kube-scheduler:v1.30.8],SizeBytes:63074110,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:44a8e24dcbba3470ee1fee21d5e88d128c936e9b55d4bc51fbef8086f8ed123b registry.k8s.io/etcd:3.5.12-0],SizeBytes:57236178,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.15-0],SizeBytes:56909194,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:cc249acbd34692826b2b335335615e060fdb3c0bca4954507aa3a1d1194de253 registry.k8s.io/e2e-test-images/agnhost:2.47],SizeBytes:52529911,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:19d4ecf1e0731b9ea55aca9c070d520f68b96ed0defbcc0e4eefe97b3d663ca3 registry.k8s.io/e2e-test-images/sample-apiserver:1.29.2],SizeBytes:39672997,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20241212-9f82dd49],SizeBytes:39008320,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:de79c8bbc271622eb94d2ee8689f189ea7c1cb6adac260a421980fe5eed66708 registry.k8s.io/sig-storage/csi-provisioner:v4.0.0],SizeBytes:29284608,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:4c148bbdf883153bc72d321be4dc55c33774a6d98b2b3e0c2da6ae389149a9b7 registry.k8s.io/sig-storage/csi-resizer:v1.10.0],SizeBytes:28038986,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:d69cc72025f7c40dae112ff989e920a3331583497c8dfb1600c5ae0e37184a29 registry.k8s.io/sig-storage/csi-attacher:v4.5.0],SizeBytes:27359336,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20241212-8ac705d0],SizeBytes:22541737,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.11.3],SizeBytes:18562039,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:49229a931e49d84454f34bd6aec9947018eacedee6fbbd8e0fc1b2aef24033c4 registry.k8s.io/sig-storage/hostpathplugin:v1.13.0],SizeBytes:17585300,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:60b89953ccfc57b9774a2da7455578c712174cbdd144b84d08657e63583041ad registry.k8s.io/build-image/distroless-iptables:v0.5.6],SizeBytes:11491940,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:c53535af8a7f7e3164609838c4b191b42b2d81238d75c1b2a2b582ada62a9780 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.0],SizeBytes:10897000,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:a9155b13325b2abef48e71de77bb8ac015412a566829f621d06bfae5c699b1b9 registry.k8s.io/e2e-test-images/busybox:1.36.1-1],SizeBytes:2223659,},ContainerImage{Names:[docker.io/library/alpine@sha256:66790a2b79e1ea3e1dabac43990c54aca5d1ddf268d9a5a0285e4167c8b24475 docker.io/library/alpine:3.6],SizeBytes:2021226,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 docker.io/library/busybox:1.28],SizeBytes:727869,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.10],SizeBytes:320368,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:299480,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2394^ea19b7f1-d6b3-11ef-b9f2-3e742d09aad4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2394^ea19b7f1-d6b3-11ef-b9f2-3e742d09aad4,DevicePath:,},},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{},},} I0119 22:23:54.095735 16 dump.go:116] Logging kubelet events for node v130-worker I0119 22:23:54.097352 16 dump.go:121] Logging pods the kubelet thinks is on node v130-worker I0119 22:23:54.106689 16 dump.go:128] kindnet-l85ml started at 2025-01-19 16:27:53 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106724 16 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0119 22:23:54.106738 16 dump.go:128] csi-mockplugin-resizer-0 started at 2025-01-19 22:23:01 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106748 16 dump.go:134] Container csi-resizer ready: true, restart count 0 I0119 22:23:54.106757 16 dump.go:128] csi-mockplugin-attacher-0 started at 2025-01-19 22:22:43 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106765 16 dump.go:134] Container csi-attacher ready: true, restart count 0 I0119 22:23:54.106774 16 dump.go:128] csi-mockplugin-resizer-0 started at 2025-01-19 22:22:43 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106782 16 dump.go:134] Container csi-resizer ready: true, restart count 0 I0119 22:23:54.106792 16 dump.go:128] e2e-w5vgb-vdn88 started at 2025-01-19 22:23:53 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106800 16 dump.go:134] Container c ready: false, restart count 0 I0119 22:23:54.106808 16 dump.go:128] csi-mockplugin-0 started at 2025-01-19 22:23:01 +0000 UTC (0+3 container statuses recorded) I0119 22:23:54.106822 16 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0119 22:23:54.106830 16 dump.go:134] Container driver-registrar ready: true, restart count 0 I0119 22:23:54.106837 16 dump.go:134] Container mock ready: true, restart count 0 I0119 22:23:54.106846 16 dump.go:128] csi-mockplugin-0 started at 2025-01-19 22:22:43 +0000 UTC (0+3 container statuses recorded) I0119 22:23:54.106853 16 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0119 22:23:54.106861 16 dump.go:134] Container driver-registrar ready: true, restart count 0 I0119 22:23:54.106869 16 dump.go:134] Container mock ready: true, restart count 0 I0119 22:23:54.106877 16 dump.go:128] back-off-cap started at 2025-01-19 22:12:36 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106886 16 dump.go:134] Container back-off-cap ready: false, restart count 6 I0119 22:23:54.106899 16 dump.go:128] kube-proxy-4tgfc started at 2025-01-19 16:27:53 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106907 16 dump.go:134] Container kube-proxy ready: true, restart count 0 I0119 22:23:54.106915 16 dump.go:128] e2e-w5vgb-cmpz9 started at 2025-01-19 22:23:53 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106922 16 dump.go:134] Container c ready: false, restart count 0 I0119 22:23:54.106931 16 dump.go:128] pvc-volume-tester-hhcnh started at 2025-01-19 22:23:08 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106939 16 dump.go:134] Container volume-tester ready: true, restart count 0 I0119 22:23:54.106948 16 dump.go:128] low-1 started at 2025-01-19 22:23:49 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106962 16 dump.go:134] Container low-1 ready: true, restart count 0 I0119 22:23:54.106976 16 dump.go:128] pvc-volume-tester-mt7cp started at 2025-01-19 22:22:50 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106984 16 dump.go:134] Container volume-tester ready: true, restart count 0 I0119 22:23:54.106992 16 dump.go:128] create-loop-devs-ltqc4 started at 2025-01-19 16:27:54 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.106999 16 dump.go:134] Container loopdev ready: true, restart count 0 I0119 22:23:54.107007 16 dump.go:128] update-demo-nautilus-pxrzn started at 2025-01-19 22:23:43 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.107015 16 dump.go:134] Container update-demo ready: true, restart count 0 I0119 22:23:54.107023 16 dump.go:128] low-2 started at 2025-01-19 22:23:51 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.107030 16 dump.go:134] Container low-2 ready: true, restart count 0 I0119 22:23:54.107038 16 dump.go:128] csi-mockplugin-0 started at 2025-01-19 22:21:42 +0000 UTC (0+4 container statuses recorded) I0119 22:23:54.107049 16 dump.go:134] Container busybox ready: true, restart count 0 I0119 22:23:54.107056 16 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0119 22:23:54.107063 16 dump.go:134] Container driver-registrar ready: true, restart count 0 I0119 22:23:54.107070 16 dump.go:134] Container mock ready: true, restart count 0 I0119 22:23:54.107079 16 dump.go:128] pod-36453ad7-437b-4b68-b4b3-a9e75883ff28 started at 2025-01-19 22:23:27 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.107086 16 dump.go:134] Container write-pod ready: false, restart count 0 I0119 22:23:54.301316 16 kubelet_metrics.go:206] Latency metrics for node v130-worker I0119 22:23:54.301340 16 dump.go:109] Logging node info for node v130-worker2 I0119 22:23:54.303960 16 dump.go:114] Node Info: &Node{ObjectMeta:{v130-worker2 959a09b5-5056-4366-9f6f-50907c6fd0eb 85617 0 2025-01-19 16:27:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:v130-worker2 kubernetes.io/os:linux topology.hostpath.csi/node:v130-worker2] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-fsgroup-policy-5708":"v130-worker2"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2025-01-19 16:27:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubelet Update v1 2025-01-19 16:27:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2025-01-19 16:27:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-01-19 22:23:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {e2e.test Update v1 2025-01-19 22:23:47 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:example.com/fakePTSRes":{}},"f:capacity":{"f:example.com/fakePTSRes":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/v130/v130-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},example.com/fakePTSRes: {{10 0} {} 10 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},example.com/fakePTSRes: {{10 0} {} 10 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67412094976 0} {} 65832124Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-01-19 22:23:33 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-01-19 22:23:33 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-01-19 22:23:33 +0000 UTC,LastTransitionTime:2025-01-19 16:27:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-01-19 22:23:33 +0000 UTC,LastTransitionTime:2025-01-19 16:28:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.24.0.5,},NodeAddress{Type:Hostname,Address:v130-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3d7c7e6b4d3945dc9fa4369e127db629,SystemUUID:6097a547-bbca-4d71-857e-d96b4c4c9155,BootID:d52356e5-71e5-4116-b104-65900319af7a,KernelVersion:5.15.0-53-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://1.7.24,KubeletVersion:v1.30.8,KubeProxyVersion:v1.30.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:b5d7ff37179c1f36f5a0201d3d3a7d33c3a5f274f6c630a4aa99501e31483a7b registry.k8s.io/kube-apiserver-amd64:v1.30.8 registry.k8s.io/kube-apiserver:v1.30.8],SizeBytes:89472999,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:769d7b09cac626d2b597dd4fecf121d0ebf97d7717931cd29af6b276e5930080 registry.k8s.io/kube-proxy-amd64:v1.30.8 registry.k8s.io/kube-proxy:v1.30.8],SizeBytes:86002872,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:49ab9f4bf0a8570c85d6fecc8a392a21237f0c258405fc704a8af107e71131ce registry.k8s.io/kube-controller-manager-amd64:v1.30.8 registry.k8s.io/kube-controller-manager:v1.30.8],SizeBytes:83529534,},ContainerImage{Names:[docker.io/library/nginx@sha256:0a399eb16751829e1af26fea27b20c3ec28d7ab1fb72182879dcae1cca21206a docker.io/library/nginx:latest],SizeBytes:72080558,},ContainerImage{Names:[docker.io/library/import-2024-12-16@sha256:3557d9cf812f95db4b9f2e00ce50985b9dfd504b4c76965c377f05281f299fbf registry.k8s.io/kube-scheduler-amd64:v1.30.8 registry.k8s.io/kube-scheduler:v1.30.8],SizeBytes:63074110,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.15-0],SizeBytes:56909194,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:cc249acbd34692826b2b335335615e060fdb3c0bca4954507aa3a1d1194de253 registry.k8s.io/e2e-test-images/agnhost:2.47],SizeBytes:52529911,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20241212-9f82dd49],SizeBytes:39008320,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:de79c8bbc271622eb94d2ee8689f189ea7c1cb6adac260a421980fe5eed66708 registry.k8s.io/sig-storage/csi-provisioner:v4.0.0],SizeBytes:29284608,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:d69cc72025f7c40dae112ff989e920a3331583497c8dfb1600c5ae0e37184a29 registry.k8s.io/sig-storage/csi-attacher:v4.5.0],SizeBytes:27359336,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20241212-8ac705d0],SizeBytes:22541737,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.11.3],SizeBytes:18562039,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:49229a931e49d84454f34bd6aec9947018eacedee6fbbd8e0fc1b2aef24033c4 registry.k8s.io/sig-storage/hostpathplugin:v1.13.0],SizeBytes:17585300,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:c53535af8a7f7e3164609838c4b191b42b2d81238d75c1b2a2b582ada62a9780 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.0],SizeBytes:10897000,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:a9155b13325b2abef48e71de77bb8ac015412a566829f621d06bfae5c699b1b9 registry.k8s.io/e2e-test-images/busybox:1.36.1-1],SizeBytes:2223659,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[docker.io/library/alpine@sha256:66790a2b79e1ea3e1dabac43990c54aca5d1ddf268d9a5a0285e4167c8b24475 docker.io/library/alpine:3.6],SizeBytes:2021226,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 docker.io/library/busybox:1.28],SizeBytes:727869,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.10],SizeBytes:320368,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:299480,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{},},} I0119 22:23:54.303974 16 dump.go:116] Logging kubelet events for node v130-worker2 I0119 22:23:54.305495 16 dump.go:121] Logging pods the kubelet thinks is on node v130-worker2 I0119 22:23:54.316247 16 dump.go:128] pod-configmaps-880bfd3f-f652-435a-ae44-1ea98b4cf219 started at 2025-01-19 22:20:12 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316271 16 dump.go:134] Container agnhost-container ready: false, restart count 0 I0119 22:23:54.316281 16 dump.go:128] kindnet-vwh7p started at 2025-01-19 16:27:53 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316290 16 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0119 22:23:54.316298 16 dump.go:128] high started at 2025-01-19 22:23:47 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316307 16 dump.go:134] Container high ready: true, restart count 0 I0119 22:23:54.316316 16 dump.go:128] hostexec-v130-worker2-9v2tj started at 2025-01-19 22:23:53 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316324 16 dump.go:134] Container agnhost-container ready: false, restart count 0 I0119 22:23:54.316332 16 dump.go:128] e2e-w5vgb-dgd2c started at 2025-01-19 22:23:50 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316340 16 dump.go:134] Container c ready: false, restart count 0 I0119 22:23:54.316349 16 dump.go:128] pvc-volume-tester-r5z67 started at 2025-01-19 22:23:43 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316356 16 dump.go:134] Container volume-tester ready: true, restart count 0 I0119 22:23:54.316365 16 dump.go:128] downwardapi-volume-102b8f6a-5e8e-4292-aafb-aec5e8283c28 started at 2025-01-19 22:23:50 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316373 16 dump.go:134] Container client-container ready: false, restart count 0 I0119 22:23:54.316381 16 dump.go:128] dns-test-fbb1d6f7-7afe-42d9-8b73-09c51c4a5e53 started at 2025-01-19 22:23:29 +0000 UTC (0+3 container statuses recorded) I0119 22:23:54.316389 16 dump.go:134] Container jessie-querier ready: true, restart count 0 I0119 22:23:54.316398 16 dump.go:134] Container querier ready: true, restart count 0 I0119 22:23:54.316405 16 dump.go:134] Container webserver ready: true, restart count 0 I0119 22:23:54.316414 16 dump.go:128] test-webserver-f6b4e790-8dfa-4368-88d0-66d179f0951a started at 2025-01-19 22:23:11 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316422 16 dump.go:134] Container test-webserver ready: false, restart count 0 I0119 22:23:54.316430 16 dump.go:128] create-loop-devs-zk7ps started at 2025-01-19 16:27:54 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316438 16 dump.go:134] Container loopdev ready: true, restart count 0 I0119 22:23:54.316447 16 dump.go:128] rally-b3b22ab4-8rq172km-ms89v started at 2025-01-19 22:23:52 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316454 16 dump.go:134] Container rally-b3b22ab4-8rq172km ready: false, restart count 0 I0119 22:23:54.316462 16 dump.go:128] e2e-w5vgb-wqzd6 started at 2025-01-19 22:23:50 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316470 16 dump.go:134] Container c ready: false, restart count 0 I0119 22:23:54.316478 16 dump.go:128] pod-18e195d6-4890-455d-beb9-bdd97c42df2a started at 2025-01-19 22:23:50 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316485 16 dump.go:134] Container write-pod ready: true, restart count 0 I0119 22:23:54.316494 16 dump.go:128] execpod4qz6t started at 2025-01-19 22:23:45 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316501 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:23:54.316510 16 dump.go:128] csi-mockplugin-0 started at 2025-01-19 22:23:36 +0000 UTC (0+3 container statuses recorded) I0119 22:23:54.316517 16 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0119 22:23:54.316526 16 dump.go:134] Container driver-registrar ready: true, restart count 0 I0119 22:23:54.316534 16 dump.go:134] Container mock ready: true, restart count 0 I0119 22:23:54.316543 16 dump.go:128] hostexec-v130-worker2-lnj9b started at 2025-01-19 22:23:43 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316551 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:23:54.316559 16 dump.go:128] pod1 started at 2025-01-19 22:23:43 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316567 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:23:54.316584 16 dump.go:128] pod-configmaps-a4fe5cf4-6632-4a22-8847-010baf4b18aa started at 2025-01-19 22:23:24 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316593 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:23:54.316601 16 dump.go:128] replace-28955423-qvn44 started at 2025-01-19 22:23:00 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316609 16 dump.go:134] Container c ready: true, restart count 0 I0119 22:23:54.316617 16 dump.go:128] test-hostpath-type-pr6lq started at 2025-01-19 22:23:53 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316625 16 dump.go:134] Container host-path-sh-testing ready: false, restart count 0 I0119 22:23:54.316633 16 dump.go:128] hostexec-v130-worker2-k2rdr started at 2025-01-19 22:18:49 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316641 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:23:54.316649 16 dump.go:128] agnhost-primary-httf6 started at 2025-01-19 22:23:45 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316657 16 dump.go:134] Container agnhost-primary ready: true, restart count 0 I0119 22:23:54.316665 16 dump.go:128] execpod8xqb6 started at 2025-01-19 22:23:42 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316671 16 dump.go:134] Container agnhost-container ready: true, restart count 0 I0119 22:23:54.316679 16 dump.go:128] kube-proxy-bfxlq started at 2025-01-19 16:27:53 +0000 UTC (0+1 container statuses recorded) I0119 22:23:54.316686 16 dump.go:134] Container kube-proxy ready: true, restart count 0 I0119 22:23:54.375560 16 kubelet_metrics.go:206] Latency metrics for node v130-worker2 STEP: Destroying namespace "sched-preemption-6373" for this suite. @ 01/19/25 22:23:54.375 << Timeline [FAILED] pods "low-3" is forbidden: no PriorityClass with name sched-preemption-low-priority was found In [It] at: k8s.io/kubernetes/test/e2e/scheduling/predicates.go:952 @ 01/19/25 22:23:53.965 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS Summarizing 2 Failures: [FAIL] [sig-scheduling] SchedulerPredicates [Serial] validates pod overhead is considered along with resource limits of pods that are allowed to run [BeforeEach] verify pod overhead is accounted for [sig-scheduling, Serial] k8s.io/kubernetes/test/e2e/scheduling/predicates.go:1164 [FAIL] [sig-scheduling] SchedulerPreemption [Serial] PodTopologySpread Preemption [It] validates proper pods are preempted [sig-scheduling, Serial] k8s.io/kubernetes/test/e2e/scheduling/predicates.go:952 Ran 14 of 7199 Specs in 719.640 seconds FAIL! -- 12 Passed | 2 Failed | 0 Pending | 7185 Skipped --- FAIL: TestE2E (720.00s) FAIL Ginkgo ran 1 suite in 12m0.7852303s Test Suite Failed