Running Suite: Kubernetes e2e suite - /usr/local/bin ==================================================== Random Seed: 1713463431 - will randomize all specs Will run 229 of 7069 specs Running in parallel across 10 processes ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVC test/e2e/storage/volume_metrics.go:491 should create prometheus metrics for volume provisioning errors [Slow] test/e2e/storage/volume_metrics.go:471 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:03:52.386 Apr 18 18:03:52.386: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:03:52.389 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:03:52.4 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:03:52.404 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:03:52.408: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:03:52.409: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-1555" for this suite. 04/18/24 18:03:52.413 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.021 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVController test/e2e/storage/volume_metrics.go:500 should create unbound pv count metrics for pvc controller after creating pv only test/e2e/storage/volume_metrics.go:602 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:03:52.443 Apr 18 18:03:52.444: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:03:52.445 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:03:52.453 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:03:52.456 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:03:52.458: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:03:52.458: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-7858" for this suite. 04/18/24 18:03:52.461 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [8.414 seconds] [sig-storage] Projected downwardAPI should provide podname as non-root with fsgroup and defaultMode [LinuxOnly] [NodeFeature:FSGroup] test/e2e/common/storage/projected_downwardapi.go:109 ------------------------------ SSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [8.597 seconds] [sig-storage] Projected downwardAPI should provide podname as non-root with fsgroup [LinuxOnly] [NodeFeature:FSGroup] test/e2e/common/storage/projected_downwardapi.go:94 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [9.259 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: block] test/e2e/storage/persistent_volumes-local.go:195 Set fsGroup for local volume [BeforeEach] test/e2e/storage/persistent_volumes-local.go:264 should set fsGroup for one pod [Slow] test/e2e/storage/persistent_volumes-local.go:270 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:03:52.485 Apr 18 18:03:52.485: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:03:52.486 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:03:52.493 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:03:52.496 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:198 STEP: Initializing test volumes 04/18/24 18:03:52.506 STEP: Creating block device on node "v126-worker2" using path "/tmp/local-volume-test-65e3090e-092d-4725-9503-539705e5263c" 04/18/24 18:03:52.506 Apr 18 18:03:52.512: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-w5sfw" in namespace "persistent-local-volumes-test-3267" to be "running" Apr 18 18:03:52.514: INFO: Pod "hostexec-v126-worker2-w5sfw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.087257ms Apr 18 18:03:54.517: INFO: Pod "hostexec-v126-worker2-w5sfw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005444815s Apr 18 18:03:56.517: INFO: Pod "hostexec-v126-worker2-w5sfw": Phase="Pending", Reason="", readiness=false. Elapsed: 4.005658982s Apr 18 18:03:58.518: INFO: Pod "hostexec-v126-worker2-w5sfw": Phase="Running", Reason="", readiness=true. Elapsed: 6.006854143s Apr 18 18:03:58.518: INFO: Pod "hostexec-v126-worker2-w5sfw" satisfied condition "running" Apr 18 18:03:58.519: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-65e3090e-092d-4725-9503-539705e5263c && dd if=/dev/zero of=/tmp/local-volume-test-65e3090e-092d-4725-9503-539705e5263c/file bs=4096 count=5120 && losetup -f /tmp/local-volume-test-65e3090e-092d-4725-9503-539705e5263c/file] Namespace:persistent-local-volumes-test-3267 PodName:hostexec-v126-worker2-w5sfw ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:03:58.519: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:03:58.520: INFO: ExecWithOptions: Clientset creation Apr 18 18:03:58.520: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-3267/pods/hostexec-v126-worker2-w5sfw/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-65e3090e-092d-4725-9503-539705e5263c+%26%26+dd+if%3D%2Fdev%2Fzero+of%3D%2Ftmp%2Flocal-volume-test-65e3090e-092d-4725-9503-539705e5263c%2Ffile+bs%3D4096+count%3D5120+%26%26+losetup+-f+%2Ftmp%2Flocal-volume-test-65e3090e-092d-4725-9503-539705e5263c%2Ffile&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:03:59.034: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-65e3090e-092d-4725-9503-539705e5263c/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-3267 PodName:hostexec-v126-worker2-w5sfw ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:03:59.034: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:03:59.035: INFO: ExecWithOptions: Clientset creation Apr 18 18:03:59.035: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-3267/pods/hostexec-v126-worker2-w5sfw/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-65e3090e-092d-4725-9503-539705e5263c%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Creating local PVCs and PVs 04/18/24 18:03:59.205 Apr 18 18:03:59.205: INFO: Creating a PV followed by a PVC Apr 18 18:03:59.215: INFO: Waiting for PV local-pv5w8hd to bind to PVC pvc-knn5b Apr 18 18:03:59.215: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-knn5b] to have phase Bound Apr 18 18:03:59.218: INFO: PersistentVolumeClaim pvc-knn5b found but phase is Pending instead of Bound. Apr 18 18:04:01.222: INFO: PersistentVolumeClaim pvc-knn5b found and phase=Bound (2.007137754s) Apr 18 18:04:01.222: INFO: Waiting up to 3m0s for PersistentVolume local-pv5w8hd to have phase Bound Apr 18 18:04:01.225: INFO: PersistentVolume local-pv5w8hd found and phase=Bound (3.021229ms) [BeforeEach] Set fsGroup for local volume test/e2e/storage/persistent_volumes-local.go:264 Apr 18 18:04:01.232: INFO: We don't set fsGroup on block device, skipped. [AfterEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:04:01.232 Apr 18 18:04:01.232: INFO: Deleting PersistentVolumeClaim "pvc-knn5b" Apr 18 18:04:01.239: INFO: Deleting PersistentVolume "local-pv5w8hd" Apr 18 18:04:01.244: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-65e3090e-092d-4725-9503-539705e5263c/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-3267 PodName:hostexec-v126-worker2-w5sfw ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:04:01.244: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:04:01.246: INFO: ExecWithOptions: Clientset creation Apr 18 18:04:01.246: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-3267/pods/hostexec-v126-worker2-w5sfw/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-65e3090e-092d-4725-9503-539705e5263c%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Tear down block device "/dev/loop0" on node "v126-worker2" at path /tmp/local-volume-test-65e3090e-092d-4725-9503-539705e5263c/file 04/18/24 18:04:01.406 Apr 18 18:04:01.407: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c losetup -d /dev/loop0] Namespace:persistent-local-volumes-test-3267 PodName:hostexec-v126-worker2-w5sfw ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:04:01.407: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:04:01.408: INFO: ExecWithOptions: Clientset creation Apr 18 18:04:01.408: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-3267/pods/hostexec-v126-worker2-w5sfw/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=losetup+-d+%2Fdev%2Floop0&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory /tmp/local-volume-test-65e3090e-092d-4725-9503-539705e5263c 04/18/24 18:04:01.583 Apr 18 18:04:01.584: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-65e3090e-092d-4725-9503-539705e5263c] Namespace:persistent-local-volumes-test-3267 PodName:hostexec-v126-worker2-w5sfw ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:04:01.584: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:04:01.585: INFO: ExecWithOptions: Clientset creation Apr 18 18:04:01.585: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-3267/pods/hostexec-v126-worker2-w5sfw/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-65e3090e-092d-4725-9503-539705e5263c&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:04:01.736: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-3267" for this suite. 04/18/24 18:04:01.74 << End Captured GinkgoWriter Output We don't set fsGroup on block device, skipped. In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:266 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [4.204 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: gce-localssd-scsi-fs] [Serial] [BeforeEach] test/e2e/storage/persistent_volumes-local.go:198 One pod requesting one prebound PVC test/e2e/storage/persistent_volumes-local.go:212 should be able to mount volume and write from pod1 test/e2e/storage/persistent_volumes-local.go:241 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:04:00.89 Apr 18 18:04:00.890: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:04:00.892 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:04:00.908 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:04:00.912 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:198 Apr 18 18:04:00.928: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-jlmph" in namespace "persistent-local-volumes-test-6584" to be "running" Apr 18 18:04:00.931: INFO: Pod "hostexec-v126-worker2-jlmph": Phase="Pending", Reason="", readiness=false. Elapsed: 3.080687ms Apr 18 18:04:02.934: INFO: Pod "hostexec-v126-worker2-jlmph": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006399118s Apr 18 18:04:04.935: INFO: Pod "hostexec-v126-worker2-jlmph": Phase="Running", Reason="", readiness=true. Elapsed: 4.007170977s Apr 18 18:04:04.935: INFO: Pod "hostexec-v126-worker2-jlmph" satisfied condition "running" Apr 18 18:04:04.935: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l] Namespace:persistent-local-volumes-test-6584 PodName:hostexec-v126-worker2-jlmph ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:04:04.935: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:04:04.937: INFO: ExecWithOptions: Clientset creation Apr 18 18:04:04.937: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-6584/pods/hostexec-v126-worker2-jlmph/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=ls+-1+%2Fmnt%2Fdisks%2Fby-uuid%2Fgoogle-local-ssds-scsi-fs%2F+%7C+wc+-l&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:04:05.058: INFO: exec v126-worker2: command: ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l Apr 18 18:04:05.058: INFO: exec v126-worker2: stdout: "0\n" Apr 18 18:04:05.058: INFO: exec v126-worker2: stderr: "ls: cannot access '/mnt/disks/by-uuid/google-local-ssds-scsi-fs/': No such file or directory\n" Apr 18 18:04:05.058: INFO: exec v126-worker2: exit code: 0 Apr 18 18:04:05.058: INFO: Requires at least 1 scsi fs localSSD [AfterEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:04:05.058 [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:04:05.059: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-6584" for this suite. 04/18/24 18:04:05.073 << End Captured GinkgoWriter Output Requires at least 1 scsi fs localSSD In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:1255 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ S ------------------------------ • [SLOW TEST] [12.691 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-link] One pod requesting one prebound PVC should be able to mount volume and read from pod1 test/e2e/storage/persistent_volumes-local.go:235 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [12.938 seconds] [sig-storage] PersistentVolumes-local [Volume type: tmpfs] One pod requesting one prebound PVC should be able to mount volume and write from pod1 test/e2e/storage/persistent_volumes-local.go:241 ------------------------------ SSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [18.107 seconds] [sig-storage] HostPathType Directory [Slow] Should fail on mounting directory 'adir' when HostPathType is HostPathBlockDev test/e2e/storage/host_path_type.go:101 ------------------------------ SSS ------------------------------ • [SLOW TEST] [10.087 seconds] [sig-storage] Downward API volume should provide podname as non-root with fsgroup [LinuxOnly] [NodeFeature:FSGroup] test/e2e/common/storage/downwardapi_volume.go:94 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.032 seconds] [sig-storage] Volumes [BeforeEach] test/e2e/common/storage/volumes.go:66 NFSv3 test/e2e/common/storage/volumes.go:100 should be mountable for NFSv3 test/e2e/common/storage/volumes.go:101 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Volumes set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:04:11.206 Apr 18 18:04:11.206: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename volume 04/18/24 18:04:11.208 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:04:11.219 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:04:11.223 [BeforeEach] [sig-storage] Volumes test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Volumes test/e2e/common/storage/volumes.go:66 Apr 18 18:04:11.228: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian) [AfterEach] [sig-storage] Volumes test/e2e/framework/node/init/init.go:32 Apr 18 18:04:11.228: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Volumes test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Volumes dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Volumes tear down framework | framework.go:193 STEP: Destroying namespace "volume-2880" for this suite. 04/18/24 18:04:11.233 << End Captured GinkgoWriter Output Only supported for node OS distro [gci ubuntu custom] (not debian) In [BeforeEach] at: test/e2e/common/storage/volumes.go:67 ------------------------------ SSSSS ------------------------------ • [SLOW TEST] [19.219 seconds] [sig-storage] Dynamic Provisioning DynamicProvisioner External should let an external dynamic provisioner create and delete persistent volumes [Slow] test/e2e/storage/volume_provisioning.go:538 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.204 seconds] [sig-storage] HostPathType Block Device [Slow] Should fail on mounting block device 'ablkdev' when HostPathType is HostPathDirectory test/e2e/storage/host_path_type.go:360 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [15.169 seconds] [sig-storage] PersistentVolumes-local [Volume type: blockfswithoutformat] Set fsGroup for local volume should set fsGroup for one pod [Slow] test/e2e/storage/persistent_volumes-local.go:270 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 Ephemeral test/e2e/storage/volume_metrics.go:495 should create volume metrics with the correct BlockMode PVC ref test/e2e/storage/volume_metrics.go:477 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:04:20.307 Apr 18 18:04:20.307: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:04:20.309 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:04:20.32 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:04:20.324 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:04:20.328: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:04:20.328: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-9995" for this suite. 04/18/24 18:04:20.333 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSS ------------------------------ • [SLOW TEST] [10.094 seconds] [sig-storage] HostPathType File [Slow] Should fail on mounting file 'afile' when HostPathType is HostPathCharDev test/e2e/storage/host_path_type.go:164 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.025 seconds] [sig-storage] Pod Disks [Feature:StorageProvider] [BeforeEach] test/e2e/storage/pd.go:76 schedule a pod w/ RW PD(s) mounted to 1 or more containers, write to PD, verify content, delete pod, and repeat in rapid succession [Slow] test/e2e/storage/pd.go:233 using 1 containers and 2 PDs test/e2e/storage/pd.go:257 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:04:21.817 Apr 18 18:04:21.817: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pod-disks 04/18/24 18:04:21.818 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:04:21.827 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:04:21.83 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/storage/pd.go:76 Apr 18 18:04:21.833: INFO: Requires at least 2 nodes (not -1) [AfterEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:04:21.834: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pod-disks-4902" for this suite. 04/18/24 18:04:21.838 << End Captured GinkgoWriter Output Requires at least 2 nodes (not -1) In [BeforeEach] at: test/e2e/storage/pd.go:77 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [8.163 seconds] [sig-storage] HostPathType Character Device [Slow] Should be able to mount character device 'achardev' successfully when HostPathType is HostPathUnset test/e2e/storage/host_path_type.go:286 ------------------------------ SSSSSSSS ------------------------------ • [SLOW TEST] [26.920 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-bindmounted] Set fsGroup for local volume should set same fsGroup for two pods simultaneously [Slow] test/e2e/storage/persistent_volumes-local.go:277 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.033 seconds] [sig-storage] Dynamic Provisioning test/e2e/storage/utils/framework.go:23 DynamicProvisioner [Slow] [Feature:StorageProvider] test/e2e/storage/volume_provisioning.go:150 [It] deletion should be idempotent test/e2e/storage/volume_provisioning.go:468 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Dynamic Provisioning set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:04:32.312 Apr 18 18:04:32.312: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename volume-provisioning 04/18/24 18:04:32.313 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:04:32.323 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:04:32.327 [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/storage/volume_provisioning.go:144 [It] deletion should be idempotent test/e2e/storage/volume_provisioning.go:468 Apr 18 18:04:32.330: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] Dynamic Provisioning test/e2e/framework/node/init/init.go:32 Apr 18 18:04:32.331: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning tear down framework | framework.go:193 STEP: Destroying namespace "volume-provisioning-3672" for this suite. 04/18/24 18:04:32.339 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [It] at: test/e2e/storage/volume_provisioning.go:474 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [19.414 seconds] [sig-storage] PersistentVolumes-local [Volume type: blockfswithoutformat] Set fsGroup for local volume should set same fsGroup for two pods simultaneously [Slow] test/e2e/storage/persistent_volumes-local.go:277 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.026 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 Ephemeral test/e2e/storage/volume_metrics.go:495 should create metrics for total number of volumes in A/D Controller test/e2e/storage/volume_metrics.go:486 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:04:36.913 Apr 18 18:04:36.913: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:04:36.915 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:04:36.923 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:04:36.926 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:04:36.930: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:04:36.930: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-6720" for this suite. 04/18/24 18:04:36.934 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ • [SLOW TEST] [6.199 seconds] [sig-storage] HostPathType Character Device [Slow] Should be able to mount character device 'achardev' successfully when HostPathType is HostPathCharDev test/e2e/storage/host_path_type.go:282 ------------------------------ • [SLOW TEST] [42.935 seconds] [sig-storage] CSI mock volume storage capacity unlimited test/e2e/storage/csi_mock_volume.go:1194 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [35.141 seconds] [sig-storage] PersistentVolumes-local [Volume type: tmpfs] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:252 ------------------------------ SSSSSSSSS ------------------------------ • [SLOW TEST] [66.672 seconds] [sig-storage] CSI mock volume CSIServiceAccountToken token should not be plumbed down when CSIDriver is not deployed test/e2e/storage/csi_mock_volume.go:1638 ------------------------------ SSSSS ------------------------------ S [SKIPPED] [0.040 seconds] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/storage/utils/framework.go:23 [It] should be able to delete a non-existent PD without error test/e2e/storage/pd.go:452 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:04:59.099 Apr 18 18:04:59.099: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pod-disks 04/18/24 18:04:59.101 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:04:59.113 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:04:59.117 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/storage/pd.go:76 [It] should be able to delete a non-existent PD without error test/e2e/storage/pd.go:452 Apr 18 18:04:59.130: INFO: Only supported for providers [gce] (not local) [AfterEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:04:59.130: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pod-disks-1868" for this suite. 04/18/24 18:04:59.135 << End Captured GinkgoWriter Output Only supported for providers [gce] (not local) In [It] at: test/e2e/storage/pd.go:453 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [31.287 seconds] [sig-storage] PersistentVolumes-local [Volume type: blockfswithoutformat] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:258 ------------------------------ SSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.023 seconds] [sig-storage] Pod Disks [Feature:StorageProvider] [BeforeEach] test/e2e/storage/pd.go:76 schedule pods each with a PD, delete pod and verify detach [Slow] test/e2e/storage/pd.go:95 for read-only PD with pod delete grace period of "immediate (0s)" test/e2e/storage/pd.go:137 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:05:03.666 Apr 18 18:05:03.667: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pod-disks 04/18/24 18:05:03.668 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:05:03.675 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:05:03.678 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/storage/pd.go:76 Apr 18 18:05:03.680: INFO: Requires at least 2 nodes (not -1) [AfterEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:05:03.681: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pod-disks-5446" for this suite. 04/18/24 18:05:03.687 << End Captured GinkgoWriter Output Requires at least 2 nodes (not -1) In [BeforeEach] at: test/e2e/storage/pd.go:77 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [20.788 seconds] [sig-storage] PersistentVolumes-local [Volume type: tmpfs] One pod requesting one prebound PVC should be able to mount volume and write from pod1 test/e2e/storage/persistent_volumes-local.go:241 ------------------------------ SSSSS ------------------------------ • [SLOW TEST] [35.442 seconds] [sig-storage] PersistentVolumes-local [Volume type: block] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:252 ------------------------------ SS ------------------------------ • [SLOW TEST] [72.695 seconds] [sig-storage] CSI mock volume CSI attach test using mock driver should preserve attachment policy when no CSIDriver present test/e2e/storage/csi_mock_volume.go:392 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [31.517 seconds] [sig-storage] CSI mock volume CSI Volume expansion should expand volume by restarting pod if attach=off, nodeExpansion=on test/e2e/storage/csi_mock_volume.go:700 ------------------------------ SSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [18.550 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir] Set fsGroup for local volume should set fsGroup for one pod [Slow] test/e2e/storage/persistent_volumes-local.go:270 ------------------------------ SSSSSSSSS ------------------------------ • [SLOW TEST] [14.092 seconds] [sig-storage] HostPathType File [Slow] Should be able to mount file 'afile' successfully when HostPathType is HostPathUnset test/e2e/storage/host_path_type.go:150 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [18.082 seconds] [sig-storage] PVC Protection Verify "immediate" deletion of a PVC that is not in active use by a pod test/e2e/storage/pvc_protection.go:117 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [18.629 seconds] [sig-storage] PersistentVolumes-local [Volume type: tmpfs] One pod requesting one prebound PVC should be able to mount volume and read from pod1 test/e2e/storage/persistent_volumes-local.go:235 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [95.799 seconds] [sig-storage] CSI mock volume storage capacity exhausted, immediate binding test/e2e/storage/csi_mock_volume.go:1194 ------------------------------ SSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [16.676 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-link-bindmounted] Set fsGroup for local volume should set fsGroup for one pod [Slow] test/e2e/storage/persistent_volumes-local.go:270 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [73.457 seconds] [sig-storage] CSI mock volume CSI FSGroupPolicy [LinuxOnly] should not modify fsGroup if fsGroupPolicy=None test/e2e/storage/csi_mock_volume.go:1696 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [18.088 seconds] [sig-storage] HostPathType Directory [Slow] Should be able to mount directory 'adir' successfully when HostPathType is HostPathDirectory test/e2e/storage/host_path_type.go:78 ------------------------------ SSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [14.062 seconds] [sig-storage] HostPathType Socket [Slow] Should fail on mounting socket 'asocket' when HostPathType is HostPathCharDev test/e2e/storage/host_path_type.go:230 ------------------------------ SSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.069 seconds] [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] new files should be created with FSGroup ownership when container is root test/e2e/common/storage/empty_dir.go:56 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [8.093 seconds] [sig-storage] HostPathType Directory [Slow] Should fail on mounting directory 'adir' when HostPathType is HostPathSocket test/e2e/storage/host_path_type.go:91 ------------------------------ SSSSSSSSSS ------------------------------ • [SLOW TEST] [19.681 seconds] [sig-storage] PersistentVolumes-local [Volume type: blockfswithformat] One pod requesting one prebound PVC should be able to mount volume and write from pod1 test/e2e/storage/persistent_volumes-local.go:241 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [8.186 seconds] [sig-storage] HostPathType Block Device [Slow] Should fail on mounting block device 'ablkdev' when HostPathType is HostPathFile test/e2e/storage/host_path_type.go:365 ------------------------------ SSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 Ephemeral test/e2e/storage/volume_metrics.go:495 should create volume metrics with the correct FilesystemMode PVC ref test/e2e/storage/volume_metrics.go:474 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:05:44.736 Apr 18 18:05:44.736: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:05:44.738 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:05:44.752 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:05:44.755 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:05:44.759: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:05:44.759: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-3253" for this suite. 04/18/24 18:05:44.763 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.026 seconds] [sig-storage] Regional PD [BeforeEach] test/e2e/storage/regional_pd.go:70 RegionalPD test/e2e/storage/regional_pd.go:78 should provision storage in the allowedTopologies with delayed binding [Slow] test/e2e/storage/regional_pd.go:92 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Regional PD set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:05:44.786 Apr 18 18:05:44.786: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename regional-pd 04/18/24 18:05:44.787 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:05:44.797 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:05:44.8 [BeforeEach] [sig-storage] Regional PD test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Regional PD test/e2e/storage/regional_pd.go:70 Apr 18 18:05:44.804: INFO: Only supported for providers [gce gke] (not local) [AfterEach] [sig-storage] Regional PD test/e2e/framework/node/init/init.go:32 Apr 18 18:05:44.804: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Regional PD test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Regional PD dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Regional PD tear down framework | framework.go:193 STEP: Destroying namespace "regional-pd-8911" for this suite. 04/18/24 18:05:44.807 << End Captured GinkgoWriter Output Only supported for providers [gce gke] (not local) In [BeforeEach] at: test/e2e/storage/regional_pd.go:74 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.029 seconds] [sig-storage] Regional PD [BeforeEach] test/e2e/storage/regional_pd.go:70 RegionalPD test/e2e/storage/regional_pd.go:78 should provision storage [Slow] test/e2e/storage/regional_pd.go:79 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Regional PD set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:05:44.828 Apr 18 18:05:44.828: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename regional-pd 04/18/24 18:05:44.829 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:05:44.84 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:05:44.843 [BeforeEach] [sig-storage] Regional PD test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Regional PD test/e2e/storage/regional_pd.go:70 Apr 18 18:05:44.847: INFO: Only supported for providers [gce gke] (not local) [AfterEach] [sig-storage] Regional PD test/e2e/framework/node/init/init.go:32 Apr 18 18:05:44.847: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Regional PD test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Regional PD dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Regional PD tear down framework | framework.go:193 STEP: Destroying namespace "regional-pd-2523" for this suite. 04/18/24 18:05:44.852 << End Captured GinkgoWriter Output Only supported for providers [gce gke] (not local) In [BeforeEach] at: test/e2e/storage/regional_pd.go:74 ------------------------------ •SSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [26.959 seconds] [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity used, insufficient capacity test/e2e/storage/csi_mock_volume.go:1413 ------------------------------ SSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [15.158 seconds] [sig-storage] PersistentVolumes-local [Volume type: block] One pod requesting one prebound PVC should be able to mount volume and read from pod1 test/e2e/storage/persistent_volumes-local.go:235 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [79.719 seconds] [sig-storage] CSI mock volume storage capacity exhausted, late binding, no topology test/e2e/storage/csi_mock_volume.go:1194 ------------------------------ SSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [54.126 seconds] [sig-storage] PersistentVolumes-local StatefulSet with pod affinity [Slow] should use volumes on one node when pod has affinity test/e2e/storage/persistent_volumes-local.go:422 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [10.170 seconds] [sig-storage] HostPathType Block Device [Slow] Should be able to mount block device 'ablkdev' successfully when HostPathType is HostPathUnset test/e2e/storage/host_path_type.go:356 ------------------------------ • [SLOW TEST] [67.355 seconds] [sig-storage] CSI mock volume CSI FSGroupPolicy [LinuxOnly] should modify fsGroup if fsGroupPolicy=default test/e2e/storage/csi_mock_volume.go:1696 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.028 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVC test/e2e/storage/volume_metrics.go:491 should create volume metrics with the correct FilesystemMode PVC ref test/e2e/storage/volume_metrics.go:474 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:06:45.292 Apr 18 18:06:45.292: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:06:45.294 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:06:45.304 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:06:45.307 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:06:45.310: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:06:45.311: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-4380" for this suite. 04/18/24 18:06:45.315 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [2.215 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: gce-localssd-scsi-fs] [Serial] [BeforeEach] test/e2e/storage/persistent_volumes-local.go:198 One pod requesting one prebound PVC test/e2e/storage/persistent_volumes-local.go:212 should be able to mount volume and write from pod1 test/e2e/storage/persistent_volumes-local.go:241 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:06:48.534 Apr 18 18:06:48.534: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:06:48.536 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:06:48.547 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:06:48.552 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:198 Apr 18 18:06:48.570: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker-nlx4s" in namespace "persistent-local-volumes-test-6484" to be "running" Apr 18 18:06:48.573: INFO: Pod "hostexec-v126-worker-nlx4s": Phase="Pending", Reason="", readiness=false. Elapsed: 2.95793ms Apr 18 18:06:50.578: INFO: Pod "hostexec-v126-worker-nlx4s": Phase="Running", Reason="", readiness=true. Elapsed: 2.007787754s Apr 18 18:06:50.578: INFO: Pod "hostexec-v126-worker-nlx4s" satisfied condition "running" Apr 18 18:06:50.578: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l] Namespace:persistent-local-volumes-test-6484 PodName:hostexec-v126-worker-nlx4s ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:06:50.578: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:06:50.580: INFO: ExecWithOptions: Clientset creation Apr 18 18:06:50.580: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-6484/pods/hostexec-v126-worker-nlx4s/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=ls+-1+%2Fmnt%2Fdisks%2Fby-uuid%2Fgoogle-local-ssds-scsi-fs%2F+%7C+wc+-l&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:06:50.739: INFO: exec v126-worker: command: ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l Apr 18 18:06:50.739: INFO: exec v126-worker: stdout: "0\n" Apr 18 18:06:50.739: INFO: exec v126-worker: stderr: "ls: cannot access '/mnt/disks/by-uuid/google-local-ssds-scsi-fs/': No such file or directory\n" Apr 18 18:06:50.739: INFO: exec v126-worker: exit code: 0 Apr 18 18:06:50.739: INFO: Requires at least 1 scsi fs localSSD [AfterEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:06:50.739 [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:06:50.740: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-6484" for this suite. 04/18/24 18:06:50.744 << End Captured GinkgoWriter Output Requires at least 1 scsi fs localSSD In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:1255 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSS ------------------------------ • [SLOW TEST] [51.816 seconds] [sig-storage] PersistentVolumes-local StatefulSet with pod affinity [Slow] should use volumes on one node when pod management is parallel and pod has affinity test/e2e/storage/persistent_volumes-local.go:437 ------------------------------ SSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [7.252 seconds] [sig-storage] PersistentVolumes-local [Volume type: block] One pod requesting one prebound PVC should be able to mount volume and read from pod1 test/e2e/storage/persistent_volumes-local.go:235 ------------------------------ SSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [18.788 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:258 ------------------------------ SSSSSS ------------------------------ • [SLOW TEST] [126.045 seconds] [sig-storage] Ephemeralstorage When pod refers to non-existent ephemeral storage should allow deletion of pod with invalid volume : projected test/e2e/storage/ephemeral_volume.go:58 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [120.155 seconds] [sig-storage] PersistentVolumes Default StorageClass [LinuxOnly] pods that use multiple volumes should be reschedulable [Slow] test/e2e/storage/persistent_volumes.go:334 ------------------------------ SSSSSS ------------------------------ • [SLOW TEST] [14.720 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir] One pod requesting one prebound PVC should be able to mount volume and read from pod1 test/e2e/storage/persistent_volumes-local.go:235 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.076 seconds] [sig-storage] HostPathType Socket [Slow] Should fail on mounting socket 'asocket' when HostPathType is HostPathDirectory test/e2e/storage/host_path_type.go:220 ------------------------------ S ------------------------------ • [SLOW TEST] [14.421 seconds] [sig-storage] PersistentVolumes-local Pod with node different from PV's NodeAffinity should fail scheduling due to different NodeSelector test/e2e/storage/persistent_volumes-local.go:382 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [16.856 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-link] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:258 ------------------------------ SSS ------------------------------ • [SLOW TEST] [32.817 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-link-bindmounted] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:258 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [102.372 seconds] [sig-storage] Subpath Container restart should verify that container can restart successfully after configmaps modified test/e2e/storage/subpath.go:123 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVC test/e2e/storage/volume_metrics.go:491 should create prometheus metrics for volume provisioning and attach/detach test/e2e/storage/volume_metrics.go:466 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:07:45.207 Apr 18 18:07:45.207: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:07:45.209 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:07:45.22 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:07:45.224 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:07:45.228: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:07:45.229: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-3897" for this suite. 04/18/24 18:07:45.234 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [6.176 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: gce-localssd-scsi-fs] [Serial] [BeforeEach] test/e2e/storage/persistent_volumes-local.go:198 Set fsGroup for local volume test/e2e/storage/persistent_volumes-local.go:263 should set same fsGroup for two pods simultaneously [Slow] test/e2e/storage/persistent_volumes-local.go:277 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:07:41.304 Apr 18 18:07:41.304: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:07:41.306 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:07:41.318 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:07:41.322 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:198 Apr 18 18:07:41.337: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-8bncn" in namespace "persistent-local-volumes-test-6768" to be "running" Apr 18 18:07:41.340: INFO: Pod "hostexec-v126-worker2-8bncn": Phase="Pending", Reason="", readiness=false. Elapsed: 2.591713ms Apr 18 18:07:43.344: INFO: Pod "hostexec-v126-worker2-8bncn": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006689124s Apr 18 18:07:45.343: INFO: Pod "hostexec-v126-worker2-8bncn": Phase="Pending", Reason="", readiness=false. Elapsed: 4.006333439s Apr 18 18:07:47.344: INFO: Pod "hostexec-v126-worker2-8bncn": Phase="Running", Reason="", readiness=true. Elapsed: 6.006800803s Apr 18 18:07:47.344: INFO: Pod "hostexec-v126-worker2-8bncn" satisfied condition "running" Apr 18 18:07:47.344: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l] Namespace:persistent-local-volumes-test-6768 PodName:hostexec-v126-worker2-8bncn ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:07:47.344: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:07:47.345: INFO: ExecWithOptions: Clientset creation Apr 18 18:07:47.345: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-6768/pods/hostexec-v126-worker2-8bncn/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=ls+-1+%2Fmnt%2Fdisks%2Fby-uuid%2Fgoogle-local-ssds-scsi-fs%2F+%7C+wc+-l&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:07:47.469: INFO: exec v126-worker2: command: ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l Apr 18 18:07:47.469: INFO: exec v126-worker2: stdout: "0\n" Apr 18 18:07:47.469: INFO: exec v126-worker2: stderr: "ls: cannot access '/mnt/disks/by-uuid/google-local-ssds-scsi-fs/': No such file or directory\n" Apr 18 18:07:47.469: INFO: exec v126-worker2: exit code: 0 Apr 18 18:07:47.469: INFO: Requires at least 1 scsi fs localSSD [AfterEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:07:47.469 [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:07:47.470: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-6768" for this suite. 04/18/24 18:07:47.475 << End Captured GinkgoWriter Output Requires at least 1 scsi fs localSSD In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:1255 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [126.049 seconds] [sig-storage] Ephemeralstorage When pod refers to non-existent ephemeral storage should allow deletion of pod with invalid volume : configmap test/e2e/storage/ephemeral_volume.go:58 ------------------------------ • [SLOW TEST] [5.092 seconds] [sig-storage] PV Protection Verify that PV bound to a PVC is not removed immediately test/e2e/storage/pv_protection.go:110 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [2.205 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: gce-localssd-scsi-fs] [Serial] [BeforeEach] test/e2e/storage/persistent_volumes-local.go:198 Two pods mounting a local volume at the same time test/e2e/storage/persistent_volumes-local.go:251 should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:252 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:07:47.623 Apr 18 18:07:47.623: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:07:47.624 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:07:47.635 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:07:47.639 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:198 Apr 18 18:07:47.656: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker-wjfhz" in namespace "persistent-local-volumes-test-5397" to be "running" Apr 18 18:07:47.659: INFO: Pod "hostexec-v126-worker-wjfhz": Phase="Pending", Reason="", readiness=false. Elapsed: 3.023088ms Apr 18 18:07:49.663: INFO: Pod "hostexec-v126-worker-wjfhz": Phase="Running", Reason="", readiness=true. Elapsed: 2.006877164s Apr 18 18:07:49.663: INFO: Pod "hostexec-v126-worker-wjfhz" satisfied condition "running" Apr 18 18:07:49.663: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l] Namespace:persistent-local-volumes-test-5397 PodName:hostexec-v126-worker-wjfhz ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:07:49.663: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:07:49.664: INFO: ExecWithOptions: Clientset creation Apr 18 18:07:49.664: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-5397/pods/hostexec-v126-worker-wjfhz/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=ls+-1+%2Fmnt%2Fdisks%2Fby-uuid%2Fgoogle-local-ssds-scsi-fs%2F+%7C+wc+-l&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:07:49.816: INFO: exec v126-worker: command: ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l Apr 18 18:07:49.816: INFO: exec v126-worker: stdout: "0\n" Apr 18 18:07:49.816: INFO: exec v126-worker: stderr: "ls: cannot access '/mnt/disks/by-uuid/google-local-ssds-scsi-fs/': No such file or directory\n" Apr 18 18:07:49.816: INFO: exec v126-worker: exit code: 0 Apr 18 18:07:49.816: INFO: Requires at least 1 scsi fs localSSD [AfterEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:07:49.817 [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:07:49.817: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-5397" for this suite. 04/18/24 18:07:49.822 << End Captured GinkgoWriter Output Requires at least 1 scsi fs localSSD In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:1255 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSS ------------------------------ • [SLOW TEST] [18.629 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-link] One pod requesting one prebound PVC should be able to mount volume and read from pod1 test/e2e/storage/persistent_volumes-local.go:235 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.093 seconds] [sig-storage] HostPathType File [Slow] Should fail on mounting file 'afile' when HostPathType is HostPathDirectory test/e2e/storage/host_path_type.go:154 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSS ------------------------------ • [SLOW TEST] [8.063 seconds] [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] volume on default medium should have the correct mode using FSGroup test/e2e/common/storage/empty_dir.go:72 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.033 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVC test/e2e/storage/volume_metrics.go:491 should create metrics for total number of volumes in A/D Controller test/e2e/storage/volume_metrics.go:486 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:07:56.002 Apr 18 18:07:56.002: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:07:56.004 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:07:56.016 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:07:56.02 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:07:56.025: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:07:56.025: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-6742" for this suite. 04/18/24 18:07:56.03 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSS ------------------------------ • [SLOW TEST] [18.087 seconds] [sig-storage] HostPathType File [Slow] Should be able to mount file 'afile' successfully when HostPathType is HostPathFile test/e2e/storage/host_path_type.go:146 ------------------------------ SSSSSSSSSSSS ------------------------------ S [SKIPPED] [2.204 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: gce-localssd-scsi-fs] [Serial] [BeforeEach] test/e2e/storage/persistent_volumes-local.go:198 One pod requesting one prebound PVC test/e2e/storage/persistent_volumes-local.go:212 should be able to mount volume and write from pod1 test/e2e/storage/persistent_volumes-local.go:241 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:08:07.934 Apr 18 18:08:07.934: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:08:07.935 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:08:07.946 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:08:07.95 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:198 Apr 18 18:08:07.964: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-dbsnj" in namespace "persistent-local-volumes-test-3614" to be "running" Apr 18 18:08:07.967: INFO: Pod "hostexec-v126-worker2-dbsnj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.774797ms Apr 18 18:08:09.971: INFO: Pod "hostexec-v126-worker2-dbsnj": Phase="Running", Reason="", readiness=true. Elapsed: 2.007224798s Apr 18 18:08:09.971: INFO: Pod "hostexec-v126-worker2-dbsnj" satisfied condition "running" Apr 18 18:08:09.971: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l] Namespace:persistent-local-volumes-test-3614 PodName:hostexec-v126-worker2-dbsnj ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:09.971: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:09.973: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:09.973: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-3614/pods/hostexec-v126-worker2-dbsnj/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=ls+-1+%2Fmnt%2Fdisks%2Fby-uuid%2Fgoogle-local-ssds-scsi-fs%2F+%7C+wc+-l&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:10.127: INFO: exec v126-worker2: command: ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l Apr 18 18:08:10.127: INFO: exec v126-worker2: stdout: "0\n" Apr 18 18:08:10.127: INFO: exec v126-worker2: stderr: "ls: cannot access '/mnt/disks/by-uuid/google-local-ssds-scsi-fs/': No such file or directory\n" Apr 18 18:08:10.127: INFO: exec v126-worker2: exit code: 0 Apr 18 18:08:10.127: INFO: Requires at least 1 scsi fs localSSD [AfterEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:08:10.127 [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:08:10.128: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-3614" for this suite. 04/18/24 18:08:10.132 << End Captured GinkgoWriter Output Requires at least 1 scsi fs localSSD In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:1255 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [65.419 seconds] [sig-storage] CSI mock volume CSI FSGroupPolicy [LinuxOnly] should modify fsGroup if fsGroupPolicy=File test/e2e/storage/csi_mock_volume.go:1696 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.099 seconds] [sig-storage] HostPathType File [Slow] Should fail on mounting file 'afile' when HostPathType is HostPathBlockDev test/e2e/storage/host_path_type.go:169 ------------------------------ SSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [36.997 seconds] [sig-storage] CSI mock volume CSI NodeStage error cases [Slow] should call NodeUnstage after NodeStage success test/e2e/storage/csi_mock_volume.go:942 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.097 seconds] [sig-storage] HostPathType File [Slow] Should fail on mounting file 'afile' when HostPathType is HostPathSocket test/e2e/storage/host_path_type.go:159 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [44.453 seconds] [sig-storage] CSI mock volume CSI NodeUnstage error cases [Slow] should call NodeStage after NodeUnstage success test/e2e/storage/csi_mock_volume.go:1075 ------------------------------ SSSSSSSSSS ------------------------------ S [SKIPPED] [0.039 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVC test/e2e/storage/volume_metrics.go:491 should create volume metrics with the correct BlockMode PVC ref test/e2e/storage/volume_metrics.go:477 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:08:35.863 Apr 18 18:08:35.863: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:08:35.865 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:08:35.877 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:08:35.882 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:08:35.886: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:08:35.886: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-149" for this suite. 04/18/24 18:08:35.892 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSS ------------------------------ S [SKIPPED] [31.969 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 StatefulSet with pod affinity [Slow] test/e2e/storage/persistent_volumes-local.go:387 [It] should use volumes spread across nodes when pod has anti-affinity test/e2e/storage/persistent_volumes-local.go:413 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:08:14.992 Apr 18 18:08:14.992: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:08:14.994 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:08:15.006 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:08:15.01 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] StatefulSet with pod affinity [Slow] test/e2e/storage/persistent_volumes-local.go:394 STEP: Setting up local volumes on node "v126-worker" 04/18/24 18:08:15.023 STEP: Initializing test volumes 04/18/24 18:08:15.024 Apr 18 18:08:15.032: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker-qqx4k" in namespace "persistent-local-volumes-test-40" to be "running" Apr 18 18:08:15.035: INFO: Pod "hostexec-v126-worker-qqx4k": Phase="Pending", Reason="", readiness=false. Elapsed: 3.187694ms Apr 18 18:08:17.039: INFO: Pod "hostexec-v126-worker-qqx4k": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007172619s Apr 18 18:08:19.039: INFO: Pod "hostexec-v126-worker-qqx4k": Phase="Pending", Reason="", readiness=false. Elapsed: 4.006945262s Apr 18 18:08:21.040: INFO: Pod "hostexec-v126-worker-qqx4k": Phase="Running", Reason="", readiness=true. Elapsed: 6.007905866s Apr 18 18:08:21.040: INFO: Pod "hostexec-v126-worker-qqx4k" satisfied condition "running" Apr 18 18:08:21.040: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-6b88bee1-8343-41dd-b2d9-c113ed8cdb83] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:21.040: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:21.042: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:21.042: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-6b88bee1-8343-41dd-b2d9-c113ed8cdb83&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:21.211: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-d9d067a2-8ace-48d8-8d59-ee7970e8efed] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:21.211: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:21.213: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:21.213: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-d9d067a2-8ace-48d8-8d59-ee7970e8efed&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:21.366: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-a71926f1-fbeb-47ca-8603-2a7436728fcb] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:21.366: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:21.367: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:21.367: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-a71926f1-fbeb-47ca-8603-2a7436728fcb&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:21.537: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-445a3b14-8982-4248-9232-59517c0f5e9e] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:21.537: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:21.539: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:21.539: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-445a3b14-8982-4248-9232-59517c0f5e9e&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:21.684: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-12caab5b-c0a5-459e-b2a4-7a707bf2f8cf] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:21.684: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:21.686: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:21.686: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-12caab5b-c0a5-459e-b2a4-7a707bf2f8cf&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:21.819: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-bb065107-e328-442c-8a4e-119330def49c] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:21.819: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:21.820: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:21.820: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-bb065107-e328-442c-8a4e-119330def49c&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Creating local PVCs and PVs 04/18/24 18:08:21.943 Apr 18 18:08:21.944: INFO: Creating a PV followed by a PVC Apr 18 18:08:21.954: INFO: Creating a PV followed by a PVC Apr 18 18:08:21.963: INFO: Creating a PV followed by a PVC Apr 18 18:08:21.972: INFO: Creating a PV followed by a PVC Apr 18 18:08:21.979: INFO: Creating a PV followed by a PVC Apr 18 18:08:21.987: INFO: Creating a PV followed by a PVC Apr 18 18:08:32.043: INFO: PVCs were not bound within 10s (that's good) STEP: Setting up local volumes on node "v126-worker2" 04/18/24 18:08:32.043 STEP: Initializing test volumes 04/18/24 18:08:32.043 Apr 18 18:08:32.049: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-6hhlt" in namespace "persistent-local-volumes-test-40" to be "running" Apr 18 18:08:32.052: INFO: Pod "hostexec-v126-worker2-6hhlt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.977376ms Apr 18 18:08:34.056: INFO: Pod "hostexec-v126-worker2-6hhlt": Phase="Running", Reason="", readiness=true. Elapsed: 2.007275643s Apr 18 18:08:34.057: INFO: Pod "hostexec-v126-worker2-6hhlt" satisfied condition "running" Apr 18 18:08:34.057: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-601dbb22-d9e7-4607-8b3b-1e4641cba404] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:34.057: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:34.058: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:34.058: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-601dbb22-d9e7-4607-8b3b-1e4641cba404&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:34.224: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-c1e8a42e-2e74-4661-8503-ea72ed7b1f72] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:34.224: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:34.225: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:34.225: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-c1e8a42e-2e74-4661-8503-ea72ed7b1f72&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:34.377: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-05bc7d46-d571-4fee-9f03-79d55661316f] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:34.377: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:34.378: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:34.378: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-05bc7d46-d571-4fee-9f03-79d55661316f&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:34.521: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-8edbbf16-ee53-4b25-bb99-a309019a41f9] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:34.521: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:34.523: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:34.523: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-8edbbf16-ee53-4b25-bb99-a309019a41f9&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:34.669: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-db56bc65-ae34-4076-977c-63311f2a46ed] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:34.669: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:34.670: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:34.670: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-db56bc65-ae34-4076-977c-63311f2a46ed&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:08:34.839: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-ee6efb9f-5a34-4e3f-8384-6f491695f5a5] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:34.839: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:34.840: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:34.840: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-ee6efb9f-5a34-4e3f-8384-6f491695f5a5&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Creating local PVCs and PVs 04/18/24 18:08:35.001 Apr 18 18:08:35.002: INFO: Creating a PV followed by a PVC Apr 18 18:08:35.011: INFO: Creating a PV followed by a PVC Apr 18 18:08:35.020: INFO: Creating a PV followed by a PVC Apr 18 18:08:35.029: INFO: Creating a PV followed by a PVC Apr 18 18:08:35.037: INFO: Creating a PV followed by a PVC Apr 18 18:08:35.045: INFO: Creating a PV followed by a PVC Apr 18 18:08:45.103: INFO: PVCs were not bound within 10s (that's good) [It] should use volumes spread across nodes when pod has anti-affinity test/e2e/storage/persistent_volumes-local.go:413 Apr 18 18:08:45.103: INFO: Runs only when number of nodes >= 3 [AfterEach] StatefulSet with pod affinity [Slow] test/e2e/storage/persistent_volumes-local.go:406 STEP: Cleaning up PVC and PV 04/18/24 18:08:45.104 Apr 18 18:08:45.104: INFO: Deleting PersistentVolumeClaim "pvc-sgnfh" Apr 18 18:08:45.109: INFO: Deleting PersistentVolume "local-pv7vj8t" STEP: Cleaning up PVC and PV 04/18/24 18:08:45.114 Apr 18 18:08:45.114: INFO: Deleting PersistentVolumeClaim "pvc-pkjbf" Apr 18 18:08:45.119: INFO: Deleting PersistentVolume "local-pvkj8dx" STEP: Cleaning up PVC and PV 04/18/24 18:08:45.125 Apr 18 18:08:45.125: INFO: Deleting PersistentVolumeClaim "pvc-b5rfc" Apr 18 18:08:45.131: INFO: Deleting PersistentVolume "local-pv4tckd" STEP: Cleaning up PVC and PV 04/18/24 18:08:45.136 Apr 18 18:08:45.136: INFO: Deleting PersistentVolumeClaim "pvc-djk7t" Apr 18 18:08:45.141: INFO: Deleting PersistentVolume "local-pvn8444" STEP: Cleaning up PVC and PV 04/18/24 18:08:45.145 Apr 18 18:08:45.146: INFO: Deleting PersistentVolumeClaim "pvc-mrhx8" Apr 18 18:08:45.150: INFO: Deleting PersistentVolume "local-pvq7wzs" STEP: Cleaning up PVC and PV 04/18/24 18:08:45.155 Apr 18 18:08:45.155: INFO: Deleting PersistentVolumeClaim "pvc-lvlhr" Apr 18 18:08:45.160: INFO: Deleting PersistentVolume "local-pv4gs49" STEP: Removing the test directory 04/18/24 18:08:45.165 Apr 18 18:08:45.165: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-6b88bee1-8343-41dd-b2d9-c113ed8cdb83] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:45.165: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:45.167: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:45.167: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-6b88bee1-8343-41dd-b2d9-c113ed8cdb83&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:08:45.324 Apr 18 18:08:45.324: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-d9d067a2-8ace-48d8-8d59-ee7970e8efed] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:45.324: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:45.325: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:45.325: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-d9d067a2-8ace-48d8-8d59-ee7970e8efed&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:08:45.486 Apr 18 18:08:45.487: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-a71926f1-fbeb-47ca-8603-2a7436728fcb] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:45.487: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:45.488: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:45.488: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-a71926f1-fbeb-47ca-8603-2a7436728fcb&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:08:45.637 Apr 18 18:08:45.637: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-445a3b14-8982-4248-9232-59517c0f5e9e] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:45.637: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:45.638: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:45.638: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-445a3b14-8982-4248-9232-59517c0f5e9e&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:08:45.802 Apr 18 18:08:45.802: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-12caab5b-c0a5-459e-b2a4-7a707bf2f8cf] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:45.802: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:45.804: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:45.804: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-12caab5b-c0a5-459e-b2a4-7a707bf2f8cf&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:08:45.948 Apr 18 18:08:45.948: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-bb065107-e328-442c-8a4e-119330def49c] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker-qqx4k ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:45.948: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:45.950: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:45.950: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker-qqx4k/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-bb065107-e328-442c-8a4e-119330def49c&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Cleaning up PVC and PV 04/18/24 18:08:46.091 Apr 18 18:08:46.091: INFO: Deleting PersistentVolumeClaim "pvc-7z9nb" Apr 18 18:08:46.096: INFO: Deleting PersistentVolume "local-pvt6fqg" STEP: Cleaning up PVC and PV 04/18/24 18:08:46.101 Apr 18 18:08:46.101: INFO: Deleting PersistentVolumeClaim "pvc-tcrx4" Apr 18 18:08:46.106: INFO: Deleting PersistentVolume "local-pvjv2pc" STEP: Cleaning up PVC and PV 04/18/24 18:08:46.111 Apr 18 18:08:46.111: INFO: Deleting PersistentVolumeClaim "pvc-ms8cc" Apr 18 18:08:46.115: INFO: Deleting PersistentVolume "local-pvfklb6" STEP: Cleaning up PVC and PV 04/18/24 18:08:46.121 Apr 18 18:08:46.121: INFO: Deleting PersistentVolumeClaim "pvc-mx8g4" Apr 18 18:08:46.125: INFO: Deleting PersistentVolume "local-pvvjjsn" STEP: Cleaning up PVC and PV 04/18/24 18:08:46.13 Apr 18 18:08:46.130: INFO: Deleting PersistentVolumeClaim "pvc-wp9hb" Apr 18 18:08:46.134: INFO: Deleting PersistentVolume "local-pvq9mdc" STEP: Cleaning up PVC and PV 04/18/24 18:08:46.139 Apr 18 18:08:46.139: INFO: Deleting PersistentVolumeClaim "pvc-q9f95" Apr 18 18:08:46.144: INFO: Deleting PersistentVolume "local-pv6nl4b" STEP: Removing the test directory 04/18/24 18:08:46.148 Apr 18 18:08:46.148: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-601dbb22-d9e7-4607-8b3b-1e4641cba404] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:46.148: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:46.150: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:46.150: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-601dbb22-d9e7-4607-8b3b-1e4641cba404&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:08:46.268 Apr 18 18:08:46.268: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-c1e8a42e-2e74-4661-8503-ea72ed7b1f72] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:46.268: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:46.269: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:46.269: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-c1e8a42e-2e74-4661-8503-ea72ed7b1f72&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:08:46.43 Apr 18 18:08:46.430: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-05bc7d46-d571-4fee-9f03-79d55661316f] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:46.431: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:46.432: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:46.432: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-05bc7d46-d571-4fee-9f03-79d55661316f&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:08:46.592 Apr 18 18:08:46.592: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-8edbbf16-ee53-4b25-bb99-a309019a41f9] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:46.592: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:46.593: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:46.593: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-8edbbf16-ee53-4b25-bb99-a309019a41f9&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:08:46.718 Apr 18 18:08:46.718: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-db56bc65-ae34-4076-977c-63311f2a46ed] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:46.718: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:46.719: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:46.720: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-db56bc65-ae34-4076-977c-63311f2a46ed&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:08:46.831 Apr 18 18:08:46.831: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-ee6efb9f-5a34-4e3f-8384-6f491695f5a5] Namespace:persistent-local-volumes-test-40 PodName:hostexec-v126-worker2-6hhlt ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:08:46.831: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:08:46.832: INFO: ExecWithOptions: Clientset creation Apr 18 18:08:46.832: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-40/pods/hostexec-v126-worker2-6hhlt/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-ee6efb9f-5a34-4e3f-8384-6f491695f5a5&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:08:46.952: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-40" for this suite. 04/18/24 18:08:46.956 << End Captured GinkgoWriter Output Runs only when number of nodes >= 3 In [It] at: test/e2e/storage/persistent_volumes-local.go:415 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [15.034 seconds] [sig-storage] PersistentVolumes-local [Volume type: tmpfs] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:258 ------------------------------ SSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.029 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVController test/e2e/storage/volume_metrics.go:500 should create bound pv/pvc count metrics for pvc controller after creating both pv and pvc test/e2e/storage/volume_metrics.go:620 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:08:50.958 Apr 18 18:08:50.958: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:08:50.959 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:08:50.97 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:08:50.974 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:08:50.978: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:08:50.978: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-5099" for this suite. 04/18/24 18:08:50.982 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [193.960 seconds] [sig-storage] CSI mock volume CSI NodeStage error cases [Slow] should call NodeUnstage after NodeStage ephemeral error test/e2e/storage/csi_mock_volume.go:942 ------------------------------ SSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [41.973 seconds] [sig-storage] CSI mock volume CSI Volume expansion should expand volume without restarting pod if nodeExpansion=off test/e2e/storage/csi_mock_volume.go:700 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [14.089 seconds] [sig-storage] HostPathType Directory [Slow] Should be able to mount directory 'adir' successfully when HostPathType is HostPathUnset test/e2e/storage/host_path_type.go:82 ------------------------------ SSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [300.066 seconds] [sig-storage] ConfigMap Should fail non-optional pod creation due to configMap object does not exist [Slow] test/e2e/common/storage/configmap_volume.go:557 ------------------------------ SSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] Regional PD [BeforeEach] test/e2e/storage/regional_pd.go:70 RegionalPD test/e2e/storage/regional_pd.go:78 should provision storage in the allowedTopologies [Slow] test/e2e/storage/regional_pd.go:88 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Regional PD set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:09:05.181 Apr 18 18:09:05.181: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename regional-pd 04/18/24 18:09:05.182 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:09:05.193 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:09:05.197 [BeforeEach] [sig-storage] Regional PD test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Regional PD test/e2e/storage/regional_pd.go:70 Apr 18 18:09:05.202: INFO: Only supported for providers [gce gke] (not local) [AfterEach] [sig-storage] Regional PD test/e2e/framework/node/init/init.go:32 Apr 18 18:09:05.202: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Regional PD test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Regional PD dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Regional PD tear down framework | framework.go:193 STEP: Destroying namespace "regional-pd-5935" for this suite. 04/18/24 18:09:05.207 << End Captured GinkgoWriter Output Only supported for providers [gce gke] (not local) In [BeforeEach] at: test/e2e/storage/regional_pd.go:74 ------------------------------ SSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [2.226 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: gce-localssd-scsi-fs] [Serial] [BeforeEach] test/e2e/storage/persistent_volumes-local.go:198 Two pods mounting a local volume at the same time test/e2e/storage/persistent_volumes-local.go:251 should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:252 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:09:09.374 Apr 18 18:09:09.375: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:09:09.376 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:09:09.389 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:09:09.393 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:198 Apr 18 18:09:09.410: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-9sqpn" in namespace "persistent-local-volumes-test-6882" to be "running" Apr 18 18:09:09.414: INFO: Pod "hostexec-v126-worker2-9sqpn": Phase="Pending", Reason="", readiness=false. Elapsed: 3.190772ms Apr 18 18:09:11.418: INFO: Pod "hostexec-v126-worker2-9sqpn": Phase="Running", Reason="", readiness=true. Elapsed: 2.007256813s Apr 18 18:09:11.418: INFO: Pod "hostexec-v126-worker2-9sqpn" satisfied condition "running" Apr 18 18:09:11.418: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l] Namespace:persistent-local-volumes-test-6882 PodName:hostexec-v126-worker2-9sqpn ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:09:11.418: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:09:11.419: INFO: ExecWithOptions: Clientset creation Apr 18 18:09:11.419: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-6882/pods/hostexec-v126-worker2-9sqpn/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=ls+-1+%2Fmnt%2Fdisks%2Fby-uuid%2Fgoogle-local-ssds-scsi-fs%2F+%7C+wc+-l&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:09:11.588: INFO: exec v126-worker2: command: ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l Apr 18 18:09:11.588: INFO: exec v126-worker2: stdout: "0\n" Apr 18 18:09:11.588: INFO: exec v126-worker2: stderr: "ls: cannot access '/mnt/disks/by-uuid/google-local-ssds-scsi-fs/': No such file or directory\n" Apr 18 18:09:11.588: INFO: exec v126-worker2: exit code: 0 Apr 18 18:09:11.588: INFO: Requires at least 1 scsi fs localSSD [AfterEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:09:11.588 [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:09:11.589: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-6882" for this suite. 04/18/24 18:09:11.594 << End Captured GinkgoWriter Output Requires at least 1 scsi fs localSSD In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:1255 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSS ------------------------------ S [SKIPPED] [0.032 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 Ephemeral test/e2e/storage/volume_metrics.go:495 should create prometheus metrics for volume provisioning and attach/detach test/e2e/storage/volume_metrics.go:466 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:09:11.612 Apr 18 18:09:11.612: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:09:11.613 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:09:11.625 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:09:11.629 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:09:11.633: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:09:11.634: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-8208" for this suite. 04/18/24 18:09:11.639 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSS ------------------------------ • [SLOW TEST] [23.329 seconds] [sig-storage] PersistentVolumes-local [Volume type: block] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:258 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [37.457 seconds] [sig-storage] CSI mock volume CSI workload information using mock driver should not be passed when CSIDriver does not exist test/e2e/storage/csi_mock_volume.go:549 ------------------------------ SSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.041 seconds] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/storage/utils/framework.go:23 schedule pods each with a PD, delete pod and verify detach [Slow] test/e2e/storage/pd.go:95 [It] for RW PD with pod delete grace period of "immediate (0s)" test/e2e/storage/pd.go:137 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:09:28.485 Apr 18 18:09:28.485: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pod-disks 04/18/24 18:09:28.487 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:09:28.5 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:09:28.504 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/storage/pd.go:76 [It] for RW PD with pod delete grace period of "immediate (0s)" test/e2e/storage/pd.go:137 Apr 18 18:09:28.517: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:09:28.517: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pod-disks-5660" for this suite. 04/18/24 18:09:28.521 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [It] at: test/e2e/storage/pd.go:138 ------------------------------ SSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [31.413 seconds] [sig-storage] PersistentVolumes-local [Volume type: blockfswithoutformat] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:258 ------------------------------ SSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] Dynamic Provisioning test/e2e/storage/utils/framework.go:23 DynamicProvisioner [Slow] [Feature:StorageProvider] test/e2e/storage/volume_provisioning.go:150 [It] should test that deleting a claim before the volume is provisioned deletes the volume. test/e2e/storage/volume_provisioning.go:422 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Dynamic Provisioning set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:09:28.948 Apr 18 18:09:28.948: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename volume-provisioning 04/18/24 18:09:28.95 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:09:28.963 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:09:28.966 [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/storage/volume_provisioning.go:144 [It] should test that deleting a claim before the volume is provisioned deletes the volume. test/e2e/storage/volume_provisioning.go:422 Apr 18 18:09:28.970: INFO: Only supported for providers [openstack gce aws gke vsphere azure] (not local) [AfterEach] [sig-storage] Dynamic Provisioning test/e2e/framework/node/init/init.go:32 Apr 18 18:09:28.970: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning tear down framework | framework.go:193 STEP: Destroying namespace "volume-provisioning-7347" for this suite. 04/18/24 18:09:28.975 << End Captured GinkgoWriter Output Only supported for providers [openstack gce aws gke vsphere azure] (not local) In [It] at: test/e2e/storage/volume_provisioning.go:428 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [12.954 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-link] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:252 ------------------------------ SSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [112.715 seconds] [sig-storage] CSI mock volume Delegate FSGroup to CSI driver [LinuxOnly] should not pass FSGroup to CSI driver if it is set in pod and driver supports VOLUME_MOUNT_GROUP test/e2e/storage/csi_mock_volume.go:1771 ------------------------------ SSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [22.436 seconds] [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity used, no capacity test/e2e/storage/csi_mock_volume.go:1413 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [12.910 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: block] test/e2e/storage/persistent_volumes-local.go:195 Set fsGroup for local volume [BeforeEach] test/e2e/storage/persistent_volumes-local.go:264 should set same fsGroup for two pods simultaneously [Slow] test/e2e/storage/persistent_volumes-local.go:277 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:09:48.779 Apr 18 18:09:48.779: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:09:48.781 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:09:48.792 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:09:48.796 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:198 STEP: Initializing test volumes 04/18/24 18:09:48.808 STEP: Creating block device on node "v126-worker2" using path "/tmp/local-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc" 04/18/24 18:09:48.808 Apr 18 18:09:48.816: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-xqchv" in namespace "persistent-local-volumes-test-7478" to be "running" Apr 18 18:09:48.819: INFO: Pod "hostexec-v126-worker2-xqchv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.895035ms Apr 18 18:09:50.822: INFO: Pod "hostexec-v126-worker2-xqchv": Phase="Running", Reason="", readiness=true. Elapsed: 2.00617203s Apr 18 18:09:50.822: INFO: Pod "hostexec-v126-worker2-xqchv" satisfied condition "running" Apr 18 18:09:50.822: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc && dd if=/dev/zero of=/tmp/local-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc/file bs=4096 count=5120 && losetup -f /tmp/local-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc/file] Namespace:persistent-local-volumes-test-7478 PodName:hostexec-v126-worker2-xqchv ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:09:50.822: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:09:50.824: INFO: ExecWithOptions: Clientset creation Apr 18 18:09:50.824: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-7478/pods/hostexec-v126-worker2-xqchv/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc+%26%26+dd+if%3D%2Fdev%2Fzero+of%3D%2Ftmp%2Flocal-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc%2Ffile+bs%3D4096+count%3D5120+%26%26+losetup+-f+%2Ftmp%2Flocal-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc%2Ffile&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:09:51.000: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-7478 PodName:hostexec-v126-worker2-xqchv ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:09:51.000: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:09:51.001: INFO: ExecWithOptions: Clientset creation Apr 18 18:09:51.002: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-7478/pods/hostexec-v126-worker2-xqchv/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Creating local PVCs and PVs 04/18/24 18:09:51.129 Apr 18 18:09:51.129: INFO: Creating a PV followed by a PVC Apr 18 18:09:51.138: INFO: Waiting for PV local-pv7k7n9 to bind to PVC pvc-fhsbt Apr 18 18:09:51.138: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-fhsbt] to have phase Bound Apr 18 18:09:51.141: INFO: PersistentVolumeClaim pvc-fhsbt found but phase is Pending instead of Bound. Apr 18 18:09:53.145: INFO: PersistentVolumeClaim pvc-fhsbt found but phase is Pending instead of Bound. Apr 18 18:09:55.149: INFO: PersistentVolumeClaim pvc-fhsbt found but phase is Pending instead of Bound. Apr 18 18:09:57.153: INFO: PersistentVolumeClaim pvc-fhsbt found but phase is Pending instead of Bound. Apr 18 18:09:59.157: INFO: PersistentVolumeClaim pvc-fhsbt found but phase is Pending instead of Bound. Apr 18 18:10:01.161: INFO: PersistentVolumeClaim pvc-fhsbt found and phase=Bound (10.02285428s) Apr 18 18:10:01.161: INFO: Waiting up to 3m0s for PersistentVolume local-pv7k7n9 to have phase Bound Apr 18 18:10:01.163: INFO: PersistentVolume local-pv7k7n9 found and phase=Bound (2.71071ms) [BeforeEach] Set fsGroup for local volume test/e2e/storage/persistent_volumes-local.go:264 Apr 18 18:10:01.169: INFO: We don't set fsGroup on block device, skipped. [AfterEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:10:01.17 Apr 18 18:10:01.170: INFO: Deleting PersistentVolumeClaim "pvc-fhsbt" Apr 18 18:10:01.175: INFO: Deleting PersistentVolume "local-pv7k7n9" Apr 18 18:10:01.180: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-7478 PodName:hostexec-v126-worker2-xqchv ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:01.180: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:01.182: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:01.182: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-7478/pods/hostexec-v126-worker2-xqchv/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Tear down block device "/dev/loop0" on node "v126-worker2" at path /tmp/local-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc/file 04/18/24 18:10:01.332 Apr 18 18:10:01.332: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c losetup -d /dev/loop0] Namespace:persistent-local-volumes-test-7478 PodName:hostexec-v126-worker2-xqchv ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:01.332: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:01.334: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:01.334: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-7478/pods/hostexec-v126-worker2-xqchv/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=losetup+-d+%2Fdev%2Floop0&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory /tmp/local-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc 04/18/24 18:10:01.524 Apr 18 18:10:01.524: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc] Namespace:persistent-local-volumes-test-7478 PodName:hostexec-v126-worker2-xqchv ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:01.524: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:01.526: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:01.526: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-7478/pods/hostexec-v126-worker2-xqchv/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-1f1f291e-6a2a-4fb9-b4ba-ebcf4e51e2fc&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:10:01.679: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-7478" for this suite. 04/18/24 18:10:01.683 << End Captured GinkgoWriter Output We don't set fsGroup on block device, skipped. In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:266 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.032 seconds] [sig-storage] Dynamic Provisioning test/e2e/storage/utils/framework.go:23 DynamicProvisioner [Slow] [Feature:StorageProvider] test/e2e/storage/volume_provisioning.go:150 [It] should provision storage with non-default reclaim policy Retain test/e2e/storage/volume_provisioning.go:375 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Dynamic Provisioning set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:10:01.707 Apr 18 18:10:01.707: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename volume-provisioning 04/18/24 18:10:01.709 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:10:01.721 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:10:01.724 [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/storage/volume_provisioning.go:144 [It] should provision storage with non-default reclaim policy Retain test/e2e/storage/volume_provisioning.go:375 Apr 18 18:10:01.728: INFO: Only supported for providers [gce gke] (not local) [AfterEach] [sig-storage] Dynamic Provisioning test/e2e/framework/node/init/init.go:32 Apr 18 18:10:01.729: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning tear down framework | framework.go:193 STEP: Destroying namespace "volume-provisioning-4389" for this suite. 04/18/24 18:10:01.733 << End Captured GinkgoWriter Output Only supported for providers [gce gke] (not local) In [It] at: test/e2e/storage/volume_provisioning.go:376 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [39.488 seconds] [sig-storage] CSI mock volume CSI workload information using mock driver should be passed when podInfoOnMount=true test/e2e/storage/csi_mock_volume.go:549 ------------------------------ • [SLOW TEST] [13.649 seconds] [sig-storage] PersistentVolumes-local [Volume type: blockfswithoutformat] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:252 ------------------------------ SSSSSSSSS ------------------------------ • [SLOW TEST] [44.470 seconds] [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity used, have capacity test/e2e/storage/csi_mock_volume.go:1413 ------------------------------ SSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [97.464 seconds] [sig-storage] CSI mock volume Delegate FSGroup to CSI driver [LinuxOnly] should pass FSGroup to CSI driver if it is set in pod and driver supports VOLUME_MOUNT_GROUP test/e2e/storage/csi_mock_volume.go:1771 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [300.058 seconds] [sig-storage] Secrets Should fail non-optional pod creation due to the key in the secret object does not exist [Slow] test/e2e/common/storage/secrets_volume.go:449 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] Regional PD [BeforeEach] test/e2e/storage/regional_pd.go:70 RegionalPD test/e2e/storage/regional_pd.go:78 should provision storage with delayed binding [Slow] test/e2e/storage/regional_pd.go:83 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Regional PD set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:11:04.211 Apr 18 18:11:04.211: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename regional-pd 04/18/24 18:11:04.213 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:11:04.224 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:11:04.228 [BeforeEach] [sig-storage] Regional PD test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Regional PD test/e2e/storage/regional_pd.go:70 Apr 18 18:11:04.232: INFO: Only supported for providers [gce gke] (not local) [AfterEach] [sig-storage] Regional PD test/e2e/framework/node/init/init.go:32 Apr 18 18:11:04.233: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Regional PD test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Regional PD dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Regional PD tear down framework | framework.go:193 STEP: Destroying namespace "regional-pd-7896" for this suite. 04/18/24 18:11:04.237 << End Captured GinkgoWriter Output Only supported for providers [gce gke] (not local) In [BeforeEach] at: test/e2e/storage/regional_pd.go:74 ------------------------------ SSSSSSSSS ------------------------------ S [SKIPPED] [27.961 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 StatefulSet with pod affinity [Slow] test/e2e/storage/persistent_volumes-local.go:387 [It] should use volumes spread across nodes when pod management is parallel and pod has anti-affinity test/e2e/storage/persistent_volumes-local.go:428 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:10:40.212 Apr 18 18:10:40.212: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:10:40.214 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:10:40.226 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:10:40.23 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] StatefulSet with pod affinity [Slow] test/e2e/storage/persistent_volumes-local.go:394 STEP: Setting up local volumes on node "v126-worker" 04/18/24 18:10:40.243 STEP: Initializing test volumes 04/18/24 18:10:40.243 Apr 18 18:10:40.250: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker-vrpw4" in namespace "persistent-local-volumes-test-1708" to be "running" Apr 18 18:10:40.253: INFO: Pod "hostexec-v126-worker-vrpw4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.886652ms Apr 18 18:10:42.256: INFO: Pod "hostexec-v126-worker-vrpw4": Phase="Running", Reason="", readiness=true. Elapsed: 2.006394612s Apr 18 18:10:42.256: INFO: Pod "hostexec-v126-worker-vrpw4" satisfied condition "running" Apr 18 18:10:42.256: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-2999a657-f743-4af4-96d8-7167a0638f8c] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:42.256: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:42.258: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:42.258: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-2999a657-f743-4af4-96d8-7167a0638f8c&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:10:42.427: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-1b8e3570-5e77-4693-b3c3-eddbdd5a487f] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:42.427: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:42.428: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:42.428: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-1b8e3570-5e77-4693-b3c3-eddbdd5a487f&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:10:42.588: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-6125a79b-4350-4522-8b26-29c1cc33b910] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:42.588: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:42.589: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:42.589: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-6125a79b-4350-4522-8b26-29c1cc33b910&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:10:42.748: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-65a77b0f-0f55-4c01-bdcb-03601478a26b] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:42.749: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:42.750: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:42.750: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-65a77b0f-0f55-4c01-bdcb-03601478a26b&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:10:42.899: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-805830dc-189e-4b1d-a01b-6a9cb26b1309] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:42.899: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:42.901: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:42.901: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-805830dc-189e-4b1d-a01b-6a9cb26b1309&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:10:43.057: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-8642659e-f517-4138-8368-7192ca1c690a] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:43.057: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:43.058: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:43.059: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-8642659e-f517-4138-8368-7192ca1c690a&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Creating local PVCs and PVs 04/18/24 18:10:43.213 Apr 18 18:10:43.213: INFO: Creating a PV followed by a PVC Apr 18 18:10:43.223: INFO: Creating a PV followed by a PVC Apr 18 18:10:43.232: INFO: Creating a PV followed by a PVC Apr 18 18:10:43.241: INFO: Creating a PV followed by a PVC Apr 18 18:10:43.250: INFO: Creating a PV followed by a PVC Apr 18 18:10:43.258: INFO: Creating a PV followed by a PVC Apr 18 18:10:53.319: INFO: PVCs were not bound within 10s (that's good) STEP: Setting up local volumes on node "v126-worker2" 04/18/24 18:10:53.319 STEP: Initializing test volumes 04/18/24 18:10:53.319 Apr 18 18:10:53.324: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-vsfcg" in namespace "persistent-local-volumes-test-1708" to be "running" Apr 18 18:10:53.327: INFO: Pod "hostexec-v126-worker2-vsfcg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.984308ms Apr 18 18:10:55.332: INFO: Pod "hostexec-v126-worker2-vsfcg": Phase="Running", Reason="", readiness=true. Elapsed: 2.007317496s Apr 18 18:10:55.332: INFO: Pod "hostexec-v126-worker2-vsfcg" satisfied condition "running" Apr 18 18:10:55.332: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-129b84ad-61fb-4136-aab0-903f5e98d620] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:55.332: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:55.333: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:55.333: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-129b84ad-61fb-4136-aab0-903f5e98d620&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:10:55.488: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-fffc1e37-6b53-4392-be2d-bab71ddc7a60] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:55.488: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:55.489: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:55.490: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-fffc1e37-6b53-4392-be2d-bab71ddc7a60&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:10:55.662: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-10471492-4820-47a6-8d05-f96cce403271] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:55.662: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:55.664: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:55.664: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-10471492-4820-47a6-8d05-f96cce403271&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:10:55.814: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-cf155940-6081-476a-81f6-25151169ee16] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:55.814: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:55.816: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:55.816: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-cf155940-6081-476a-81f6-25151169ee16&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:10:55.962: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-1dd78275-3bea-451b-85dc-0905f9aebef6] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:55.962: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:55.964: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:55.964: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-1dd78275-3bea-451b-85dc-0905f9aebef6&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:10:56.108: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-310180ca-4631-4519-9e4b-3131f9ed6e7b] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:10:56.108: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:10:56.109: INFO: ExecWithOptions: Clientset creation Apr 18 18:10:56.110: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-310180ca-4631-4519-9e4b-3131f9ed6e7b&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Creating local PVCs and PVs 04/18/24 18:10:56.268 Apr 18 18:10:56.268: INFO: Creating a PV followed by a PVC Apr 18 18:10:56.278: INFO: Creating a PV followed by a PVC Apr 18 18:10:56.286: INFO: Creating a PV followed by a PVC Apr 18 18:10:56.294: INFO: Creating a PV followed by a PVC Apr 18 18:10:56.302: INFO: Creating a PV followed by a PVC Apr 18 18:10:56.310: INFO: Creating a PV followed by a PVC Apr 18 18:11:06.365: INFO: PVCs were not bound within 10s (that's good) [It] should use volumes spread across nodes when pod management is parallel and pod has anti-affinity test/e2e/storage/persistent_volumes-local.go:428 Apr 18 18:11:06.365: INFO: Runs only when number of nodes >= 3 [AfterEach] StatefulSet with pod affinity [Slow] test/e2e/storage/persistent_volumes-local.go:406 STEP: Cleaning up PVC and PV 04/18/24 18:11:06.365 Apr 18 18:11:06.365: INFO: Deleting PersistentVolumeClaim "pvc-nhk2l" Apr 18 18:11:06.370: INFO: Deleting PersistentVolume "local-pv9xr5q" STEP: Cleaning up PVC and PV 04/18/24 18:11:06.377 Apr 18 18:11:06.377: INFO: Deleting PersistentVolumeClaim "pvc-cdwvt" Apr 18 18:11:06.382: INFO: Deleting PersistentVolume "local-pvmsg96" STEP: Cleaning up PVC and PV 04/18/24 18:11:06.387 Apr 18 18:11:06.388: INFO: Deleting PersistentVolumeClaim "pvc-5b567" Apr 18 18:11:06.392: INFO: Deleting PersistentVolume "local-pvqptw6" STEP: Cleaning up PVC and PV 04/18/24 18:11:06.397 Apr 18 18:11:06.397: INFO: Deleting PersistentVolumeClaim "pvc-7ncfs" Apr 18 18:11:06.402: INFO: Deleting PersistentVolume "local-pvz75zk" STEP: Cleaning up PVC and PV 04/18/24 18:11:06.407 Apr 18 18:11:06.407: INFO: Deleting PersistentVolumeClaim "pvc-vfshh" Apr 18 18:11:06.411: INFO: Deleting PersistentVolume "local-pvpchnr" STEP: Cleaning up PVC and PV 04/18/24 18:11:06.416 Apr 18 18:11:06.416: INFO: Deleting PersistentVolumeClaim "pvc-mcjnf" Apr 18 18:11:06.421: INFO: Deleting PersistentVolume "local-pvl4gnw" STEP: Removing the test directory 04/18/24 18:11:06.425 Apr 18 18:11:06.425: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-2999a657-f743-4af4-96d8-7167a0638f8c] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:06.425: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:06.426: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:06.426: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-2999a657-f743-4af4-96d8-7167a0638f8c&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:11:06.578 Apr 18 18:11:06.578: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-1b8e3570-5e77-4693-b3c3-eddbdd5a487f] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:06.578: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:06.580: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:06.580: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-1b8e3570-5e77-4693-b3c3-eddbdd5a487f&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:11:06.712 Apr 18 18:11:06.712: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-6125a79b-4350-4522-8b26-29c1cc33b910] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:06.712: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:06.713: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:06.713: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-6125a79b-4350-4522-8b26-29c1cc33b910&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:11:06.856 Apr 18 18:11:06.856: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-65a77b0f-0f55-4c01-bdcb-03601478a26b] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:06.856: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:06.857: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:06.858: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-65a77b0f-0f55-4c01-bdcb-03601478a26b&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:11:06.998 Apr 18 18:11:06.999: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-805830dc-189e-4b1d-a01b-6a9cb26b1309] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:06.999: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:07.000: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:07.000: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-805830dc-189e-4b1d-a01b-6a9cb26b1309&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:11:07.127 Apr 18 18:11:07.127: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-8642659e-f517-4138-8368-7192ca1c690a] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker-vrpw4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:07.127: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:07.128: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:07.128: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker-vrpw4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-8642659e-f517-4138-8368-7192ca1c690a&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Cleaning up PVC and PV 04/18/24 18:11:07.262 Apr 18 18:11:07.262: INFO: Deleting PersistentVolumeClaim "pvc-n2fq2" Apr 18 18:11:07.269: INFO: Deleting PersistentVolume "local-pvcwp4l" STEP: Cleaning up PVC and PV 04/18/24 18:11:07.275 Apr 18 18:11:07.275: INFO: Deleting PersistentVolumeClaim "pvc-hlwh2" Apr 18 18:11:07.280: INFO: Deleting PersistentVolume "local-pv5dzvp" STEP: Cleaning up PVC and PV 04/18/24 18:11:07.29 Apr 18 18:11:07.290: INFO: Deleting PersistentVolumeClaim "pvc-7hxq8" Apr 18 18:11:07.294: INFO: Deleting PersistentVolume "local-pvcwk4b" STEP: Cleaning up PVC and PV 04/18/24 18:11:07.299 Apr 18 18:11:07.299: INFO: Deleting PersistentVolumeClaim "pvc-ggs8w" Apr 18 18:11:07.304: INFO: Deleting PersistentVolume "local-pvc9zgn" STEP: Cleaning up PVC and PV 04/18/24 18:11:07.309 Apr 18 18:11:07.309: INFO: Deleting PersistentVolumeClaim "pvc-rph8c" Apr 18 18:11:07.314: INFO: Deleting PersistentVolume "local-pv5gbmz" STEP: Cleaning up PVC and PV 04/18/24 18:11:07.319 Apr 18 18:11:07.319: INFO: Deleting PersistentVolumeClaim "pvc-8cql2" Apr 18 18:11:07.324: INFO: Deleting PersistentVolume "local-pvk766d" STEP: Removing the test directory 04/18/24 18:11:07.329 Apr 18 18:11:07.329: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-129b84ad-61fb-4136-aab0-903f5e98d620] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:07.329: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:07.330: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:07.330: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-129b84ad-61fb-4136-aab0-903f5e98d620&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:11:07.463 Apr 18 18:11:07.463: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-fffc1e37-6b53-4392-be2d-bab71ddc7a60] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:07.463: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:07.464: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:07.464: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-fffc1e37-6b53-4392-be2d-bab71ddc7a60&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:11:07.595 Apr 18 18:11:07.595: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-10471492-4820-47a6-8d05-f96cce403271] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:07.595: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:07.596: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:07.596: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-10471492-4820-47a6-8d05-f96cce403271&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:11:07.743 Apr 18 18:11:07.743: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-cf155940-6081-476a-81f6-25151169ee16] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:07.743: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:07.745: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:07.745: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-cf155940-6081-476a-81f6-25151169ee16&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:11:07.878 Apr 18 18:11:07.878: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-1dd78275-3bea-451b-85dc-0905f9aebef6] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:07.878: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:07.879: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:07.879: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-1dd78275-3bea-451b-85dc-0905f9aebef6&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory 04/18/24 18:11:08.003 Apr 18 18:11:08.003: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-310180ca-4631-4519-9e4b-3131f9ed6e7b] Namespace:persistent-local-volumes-test-1708 PodName:hostexec-v126-worker2-vsfcg ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:08.003: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:08.004: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:08.004: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1708/pods/hostexec-v126-worker2-vsfcg/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-310180ca-4631-4519-9e4b-3131f9ed6e7b&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:11:08.162: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-1708" for this suite. 04/18/24 18:11:08.167 << End Captured GinkgoWriter Output Runs only when number of nodes >= 3 In [It] at: test/e2e/storage/persistent_volumes-local.go:430 ------------------------------ SS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVController test/e2e/storage/volume_metrics.go:500 should create none metrics for pvc controller before creating any PV or PVC test/e2e/storage/volume_metrics.go:598 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:11:08.177 Apr 18 18:11:08.177: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:11:08.179 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:11:08.19 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:11:08.194 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:11:08.198: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:11:08.198: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-7700" for this suite. 04/18/24 18:11:08.203 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSS ------------------------------ • [SLOW TEST] [126.051 seconds] [sig-storage] Ephemeralstorage When pod refers to non-existent ephemeral storage should allow deletion of pod with invalid volume : secret test/e2e/storage/ephemeral_volume.go:58 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.032 seconds] [sig-storage] Pod Disks [Feature:StorageProvider] [BeforeEach] test/e2e/storage/pd.go:76 schedule pods each with a PD, delete pod and verify detach [Slow] test/e2e/storage/pd.go:95 for read-only PD with pod delete grace period of "default (30s)" test/e2e/storage/pd.go:137 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:11:11.296 Apr 18 18:11:11.296: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pod-disks 04/18/24 18:11:11.298 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:11:11.309 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:11:11.313 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/storage/pd.go:76 Apr 18 18:11:11.317: INFO: Requires at least 2 nodes (not -1) [AfterEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:11:11.318: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pod-disks-1743" for this suite. 04/18/24 18:11:11.323 << End Captured GinkgoWriter Output Requires at least 2 nodes (not -1) In [BeforeEach] at: test/e2e/storage/pd.go:77 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [8.695 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-bindmounted] One pod requesting one prebound PVC should be able to mount volume and read from pod1 test/e2e/storage/persistent_volumes-local.go:235 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [10.991 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: block] test/e2e/storage/persistent_volumes-local.go:195 Set fsGroup for local volume [BeforeEach] test/e2e/storage/persistent_volumes-local.go:264 should set fsGroup for one pod [Slow] test/e2e/storage/persistent_volumes-local.go:270 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:11:20.083 Apr 18 18:11:20.083: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:11:20.084 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:11:20.096 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:11:20.1 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:198 STEP: Initializing test volumes 04/18/24 18:11:20.111 STEP: Creating block device on node "v126-worker2" using path "/tmp/local-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0" 04/18/24 18:11:20.111 Apr 18 18:11:20.119: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-fh7dl" in namespace "persistent-local-volumes-test-1715" to be "running" Apr 18 18:11:20.122: INFO: Pod "hostexec-v126-worker2-fh7dl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.704138ms Apr 18 18:11:22.126: INFO: Pod "hostexec-v126-worker2-fh7dl": Phase="Running", Reason="", readiness=true. Elapsed: 2.006899976s Apr 18 18:11:22.126: INFO: Pod "hostexec-v126-worker2-fh7dl" satisfied condition "running" Apr 18 18:11:22.126: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0 && dd if=/dev/zero of=/tmp/local-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0/file bs=4096 count=5120 && losetup -f /tmp/local-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0/file] Namespace:persistent-local-volumes-test-1715 PodName:hostexec-v126-worker2-fh7dl ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:22.126: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:22.128: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:22.128: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1715/pods/hostexec-v126-worker2-fh7dl/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0+%26%26+dd+if%3D%2Fdev%2Fzero+of%3D%2Ftmp%2Flocal-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0%2Ffile+bs%3D4096+count%3D5120+%26%26+losetup+-f+%2Ftmp%2Flocal-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0%2Ffile&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:11:22.341: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-1715 PodName:hostexec-v126-worker2-fh7dl ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:22.341: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:22.342: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:22.342: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1715/pods/hostexec-v126-worker2-fh7dl/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Creating local PVCs and PVs 04/18/24 18:11:22.508 Apr 18 18:11:22.508: INFO: Creating a PV followed by a PVC Apr 18 18:11:22.517: INFO: Waiting for PV local-pvxq2jh to bind to PVC pvc-wsmsw Apr 18 18:11:22.517: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-wsmsw] to have phase Bound Apr 18 18:11:22.520: INFO: PersistentVolumeClaim pvc-wsmsw found but phase is Pending instead of Bound. Apr 18 18:11:24.524: INFO: PersistentVolumeClaim pvc-wsmsw found but phase is Pending instead of Bound. Apr 18 18:11:26.528: INFO: PersistentVolumeClaim pvc-wsmsw found but phase is Pending instead of Bound. Apr 18 18:11:28.532: INFO: PersistentVolumeClaim pvc-wsmsw found but phase is Pending instead of Bound. Apr 18 18:11:30.536: INFO: PersistentVolumeClaim pvc-wsmsw found and phase=Bound (8.018416309s) Apr 18 18:11:30.536: INFO: Waiting up to 3m0s for PersistentVolume local-pvxq2jh to have phase Bound Apr 18 18:11:30.539: INFO: PersistentVolume local-pvxq2jh found and phase=Bound (3.05435ms) [BeforeEach] Set fsGroup for local volume test/e2e/storage/persistent_volumes-local.go:264 Apr 18 18:11:30.545: INFO: We don't set fsGroup on block device, skipped. [AfterEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:11:30.545 Apr 18 18:11:30.545: INFO: Deleting PersistentVolumeClaim "pvc-wsmsw" Apr 18 18:11:30.551: INFO: Deleting PersistentVolume "local-pvxq2jh" Apr 18 18:11:30.556: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-1715 PodName:hostexec-v126-worker2-fh7dl ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:30.556: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:30.558: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:30.558: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1715/pods/hostexec-v126-worker2-fh7dl/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Tear down block device "/dev/loop0" on node "v126-worker2" at path /tmp/local-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0/file 04/18/24 18:11:30.728 Apr 18 18:11:30.728: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c losetup -d /dev/loop0] Namespace:persistent-local-volumes-test-1715 PodName:hostexec-v126-worker2-fh7dl ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:30.728: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:30.730: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:30.730: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1715/pods/hostexec-v126-worker2-fh7dl/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=losetup+-d+%2Fdev%2Floop0&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory /tmp/local-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0 04/18/24 18:11:30.912 Apr 18 18:11:30.912: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0] Namespace:persistent-local-volumes-test-1715 PodName:hostexec-v126-worker2-fh7dl ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:11:30.912: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:11:30.913: INFO: ExecWithOptions: Clientset creation Apr 18 18:11:30.913: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-1715/pods/hostexec-v126-worker2-fh7dl/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-9b9a00ee-6456-4e9a-8365-3c0bef6b8af0&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:11:31.063: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-1715" for this suite. 04/18/24 18:11:31.068 << End Captured GinkgoWriter Output We don't set fsGroup on block device, skipped. In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:266 ------------------------------ SSSSSSSSSS ------------------------------ • [SLOW TEST] [27.461 seconds] [sig-storage] CSI mock volume CSI online volume expansion should expand volume without restarting pod if attach=off, nodeExpansion=on test/e2e/storage/csi_mock_volume.go:799 ------------------------------ SSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [304.419 seconds] [sig-storage] PersistentVolumes-local Local volume that cannot be mounted [Slow] should fail due to wrong node test/e2e/storage/persistent_volumes-local.go:327 ------------------------------ SSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [19.983 seconds] [sig-storage] PersistentVolumes-expansion loopback local block volume should support online expansion on node test/e2e/storage/local_volume_resize.go:85 ------------------------------ SSSS ------------------------------ S [SKIPPED] [0.027 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVController test/e2e/storage/volume_metrics.go:500 should create unbound pvc count metrics for pvc controller after creating pvc only test/e2e/storage/volume_metrics.go:611 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:11:51.07 Apr 18 18:11:51.070: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:11:51.071 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:11:51.081 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:11:51.084 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:11:51.087: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:11:51.088: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-2409" for this suite. 04/18/24 18:11:51.092 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [14.961 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-link] Set fsGroup for local volume should set same fsGroup for two pods simultaneously [Slow] test/e2e/storage/persistent_volumes-local.go:277 ------------------------------ SSSSSSSS ------------------------------ • [SLOW TEST] [15.300 seconds] [sig-storage] PersistentVolumes-local [Volume type: block] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:258 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.029 seconds] [sig-storage] Dynamic Provisioning test/e2e/storage/utils/framework.go:23 Invalid AWS KMS key test/e2e/storage/volume_provisioning.go:704 [It] should report an error and create no PV test/e2e/storage/volume_provisioning.go:705 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Dynamic Provisioning set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:12:06.447 Apr 18 18:12:06.447: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename volume-provisioning 04/18/24 18:12:06.449 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:12:06.46 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:12:06.463 [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/storage/volume_provisioning.go:144 [It] should report an error and create no PV test/e2e/storage/volume_provisioning.go:705 Apr 18 18:12:06.467: INFO: Only supported for providers [aws] (not local) [AfterEach] [sig-storage] Dynamic Provisioning test/e2e/framework/node/init/init.go:32 Apr 18 18:12:06.468: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning tear down framework | framework.go:193 STEP: Destroying namespace "volume-provisioning-3999" for this suite. 04/18/24 18:12:06.471 << End Captured GinkgoWriter Output Only supported for providers [aws] (not local) In [It] at: test/e2e/storage/volume_provisioning.go:706 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] Mounted volume expand [Feature:StorageProvider] [BeforeEach] test/e2e/storage/mounted_volume_resize.go:61 Should verify mounted devices can be resized test/e2e/storage/mounted_volume_resize.go:107 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Mounted volume expand [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:12:06.529 Apr 18 18:12:06.530: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename mounted-volume-expand 04/18/24 18:12:06.531 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:12:06.542 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:12:06.546 [BeforeEach] [sig-storage] Mounted volume expand [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Mounted volume expand [Feature:StorageProvider] test/e2e/storage/mounted_volume_resize.go:61 Apr 18 18:12:06.551: INFO: Only supported for providers [aws gce] (not local) [AfterEach] [sig-storage] Mounted volume expand [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:12:06.551: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Mounted volume expand [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Mounted volume expand [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Mounted volume expand [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "mounted-volume-expand-7601" for this suite. 04/18/24 18:12:06.555 << End Captured GinkgoWriter Output Only supported for providers [aws gce] (not local) In [BeforeEach] at: test/e2e/storage/mounted_volume_resize.go:62 ------------------------------ SSSSSSSSS ------------------------------ • [SLOW TEST] [14.092 seconds] [sig-storage] PVC Protection Verify that PVC in active use by a pod is not removed immediately test/e2e/storage/pvc_protection.go:129 ------------------------------ SSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [20.808 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:258 ------------------------------ SSSSSSSSS ------------------------------ • [SLOW TEST] [10.210 seconds] [sig-storage] HostPathType Block Device [Slow] Should fail on mounting block device 'ablkdev' when HostPathType is HostPathSocket test/e2e/storage/host_path_type.go:370 ------------------------------ SSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.032 seconds] [sig-storage] Pod Disks [Feature:StorageProvider] [BeforeEach] test/e2e/storage/pd.go:76 [Serial] attach on previously attached volumes should work test/e2e/storage/pd.go:461 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:12:19.34 Apr 18 18:12:19.340: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pod-disks 04/18/24 18:12:19.342 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:12:19.354 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:12:19.358 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/storage/pd.go:76 Apr 18 18:12:19.362: INFO: Requires at least 2 nodes (not -1) [AfterEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:12:19.362: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pod-disks-5018" for this suite. 04/18/24 18:12:19.367 << End Captured GinkgoWriter Output Requires at least 2 nodes (not -1) In [BeforeEach] at: test/e2e/storage/pd.go:77 ------------------------------ SSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [16.001 seconds] [sig-storage] Volumes ConfigMap should be mountable test/e2e/storage/volumes.go:50 ------------------------------ S ------------------------------ • [SLOW TEST] [103.475 seconds] [sig-storage] CSI mock volume CSI online volume expansion should expand volume without restarting pod if attach=on, nodeExpansion=on test/e2e/storage/csi_mock_volume.go:799 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [16.073 seconds] [sig-storage] HostPathType Socket [Slow] Should be able to mount socket 'asocket' successfully when HostPathType is HostPathSocket test/e2e/storage/host_path_type.go:212 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [300.053 seconds] [sig-storage] ConfigMap Should fail non-optional pod creation due to the key in the configMap object does not exist [Slow] test/e2e/common/storage/configmap_volume.go:566 ------------------------------ SSSSSSSSSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] Flexvolumes [BeforeEach] test/e2e/storage/flexvolume.go:171 should be mountable when non-attachable test/e2e/storage/flexvolume.go:190 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Flexvolumes set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:12:51.39 Apr 18 18:12:51.390: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename flexvolume 04/18/24 18:12:51.392 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:12:51.403 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:12:51.407 [BeforeEach] [sig-storage] Flexvolumes test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Flexvolumes test/e2e/storage/flexvolume.go:171 Apr 18 18:12:51.411: INFO: No SSH Key for provider local: 'error reading SSH key /home/xtesting/.ssh/id_rsa: 'open /home/xtesting/.ssh/id_rsa: no such file or directory'' [AfterEach] [sig-storage] Flexvolumes test/e2e/framework/node/init/init.go:32 Apr 18 18:12:51.412: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Flexvolumes test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Flexvolumes dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Flexvolumes tear down framework | framework.go:193 STEP: Destroying namespace "flexvolume-8455" for this suite. 04/18/24 18:12:51.416 << End Captured GinkgoWriter Output No SSH Key for provider local: 'error reading SSH key /home/xtesting/.ssh/id_rsa: 'open /home/xtesting/.ssh/id_rsa: no such file or directory'' In [BeforeEach] at: test/e2e/storage/flexvolume.go:175 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.032 seconds] [sig-storage] Pod Disks [Feature:StorageProvider] [BeforeEach] test/e2e/storage/pd.go:76 schedule a pod w/ RW PD(s) mounted to 1 or more containers, write to PD, verify content, delete pod, and repeat in rapid succession [Slow] test/e2e/storage/pd.go:233 using 4 containers and 1 PDs test/e2e/storage/pd.go:257 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:12:51.44 Apr 18 18:12:51.440: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pod-disks 04/18/24 18:12:51.442 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:12:51.454 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:12:51.458 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/storage/pd.go:76 Apr 18 18:12:51.462: INFO: Requires at least 2 nodes (not -1) [AfterEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:12:51.462: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pod-disks-7894" for this suite. 04/18/24 18:12:51.467 << End Captured GinkgoWriter Output Requires at least 2 nodes (not -1) In [BeforeEach] at: test/e2e/storage/pd.go:77 ------------------------------ S ------------------------------ S [SKIPPED] [0.030 seconds] [sig-storage] Volumes [BeforeEach] test/e2e/common/storage/volumes.go:66 NFSv4 test/e2e/common/storage/volumes.go:76 should be mountable for NFSv4 test/e2e/common/storage/volumes.go:77 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Volumes set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:12:51.475 Apr 18 18:12:51.475: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename volume 04/18/24 18:12:51.477 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:12:51.487 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:12:51.491 [BeforeEach] [sig-storage] Volumes test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Volumes test/e2e/common/storage/volumes.go:66 Apr 18 18:12:51.495: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian) [AfterEach] [sig-storage] Volumes test/e2e/framework/node/init/init.go:32 Apr 18 18:12:51.495: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Volumes test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Volumes dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Volumes tear down framework | framework.go:193 STEP: Destroying namespace "volume-6508" for this suite. 04/18/24 18:12:51.5 << End Captured GinkgoWriter Output Only supported for node OS distro [gci ubuntu custom] (not debian) In [BeforeEach] at: test/e2e/common/storage/volumes.go:67 ------------------------------ SSS ------------------------------ • [SLOW TEST] [34.102 seconds] [sig-storage] HostPathType Directory [Slow] Should fail on mounting directory 'adir' when HostPathType is HostPathFile test/e2e/storage/host_path_type.go:86 ------------------------------ SSSSSSSSSS ------------------------------ S [SKIPPED] [18.975 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: block] test/e2e/storage/persistent_volumes-local.go:195 Set fsGroup for local volume [BeforeEach] test/e2e/storage/persistent_volumes-local.go:264 should set same fsGroup for two pods simultaneously [Slow] test/e2e/storage/persistent_volumes-local.go:277 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:12:42.696 Apr 18 18:12:42.696: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:12:42.698 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:12:42.708 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:12:42.712 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:198 STEP: Initializing test volumes 04/18/24 18:12:42.725 STEP: Creating block device on node "v126-worker2" using path "/tmp/local-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da" 04/18/24 18:12:42.725 Apr 18 18:12:42.733: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-xhrqm" in namespace "persistent-local-volumes-test-5885" to be "running" Apr 18 18:12:42.736: INFO: Pod "hostexec-v126-worker2-xhrqm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.84855ms Apr 18 18:12:44.739: INFO: Pod "hostexec-v126-worker2-xhrqm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006355713s Apr 18 18:12:46.739: INFO: Pod "hostexec-v126-worker2-xhrqm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.006534607s Apr 18 18:12:48.740: INFO: Pod "hostexec-v126-worker2-xhrqm": Phase="Running", Reason="", readiness=true. Elapsed: 6.006891825s Apr 18 18:12:48.740: INFO: Pod "hostexec-v126-worker2-xhrqm" satisfied condition "running" Apr 18 18:12:48.740: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da && dd if=/dev/zero of=/tmp/local-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da/file bs=4096 count=5120 && losetup -f /tmp/local-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da/file] Namespace:persistent-local-volumes-test-5885 PodName:hostexec-v126-worker2-xhrqm ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:12:48.740: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:12:48.741: INFO: ExecWithOptions: Clientset creation Apr 18 18:12:48.741: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-5885/pods/hostexec-v126-worker2-xhrqm/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da+%26%26+dd+if%3D%2Fdev%2Fzero+of%3D%2Ftmp%2Flocal-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da%2Ffile+bs%3D4096+count%3D5120+%26%26+losetup+-f+%2Ftmp%2Flocal-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da%2Ffile&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:12:48.974: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-5885 PodName:hostexec-v126-worker2-xhrqm ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:12:48.975: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:12:48.975: INFO: ExecWithOptions: Clientset creation Apr 18 18:12:48.976: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-5885/pods/hostexec-v126-worker2-xhrqm/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Creating local PVCs and PVs 04/18/24 18:12:49.123 Apr 18 18:12:49.123: INFO: Creating a PV followed by a PVC Apr 18 18:12:49.133: INFO: Waiting for PV local-pvnlvkr to bind to PVC pvc-627km Apr 18 18:12:49.133: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-627km] to have phase Bound Apr 18 18:12:49.136: INFO: PersistentVolumeClaim pvc-627km found but phase is Pending instead of Bound. Apr 18 18:12:51.139: INFO: PersistentVolumeClaim pvc-627km found but phase is Pending instead of Bound. Apr 18 18:12:53.143: INFO: PersistentVolumeClaim pvc-627km found but phase is Pending instead of Bound. Apr 18 18:12:55.147: INFO: PersistentVolumeClaim pvc-627km found but phase is Pending instead of Bound. Apr 18 18:12:57.151: INFO: PersistentVolumeClaim pvc-627km found but phase is Pending instead of Bound. Apr 18 18:12:59.155: INFO: PersistentVolumeClaim pvc-627km found but phase is Pending instead of Bound. Apr 18 18:13:01.159: INFO: PersistentVolumeClaim pvc-627km found and phase=Bound (12.025524807s) Apr 18 18:13:01.159: INFO: Waiting up to 3m0s for PersistentVolume local-pvnlvkr to have phase Bound Apr 18 18:13:01.162: INFO: PersistentVolume local-pvnlvkr found and phase=Bound (2.855444ms) [BeforeEach] Set fsGroup for local volume test/e2e/storage/persistent_volumes-local.go:264 Apr 18 18:13:01.172: INFO: We don't set fsGroup on block device, skipped. [AfterEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:13:01.172 Apr 18 18:13:01.172: INFO: Deleting PersistentVolumeClaim "pvc-627km" Apr 18 18:13:01.177: INFO: Deleting PersistentVolume "local-pvnlvkr" Apr 18 18:13:01.183: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-5885 PodName:hostexec-v126-worker2-xhrqm ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:13:01.183: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:13:01.185: INFO: ExecWithOptions: Clientset creation Apr 18 18:13:01.185: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-5885/pods/hostexec-v126-worker2-xhrqm/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Tear down block device "/dev/loop0" on node "v126-worker2" at path /tmp/local-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da/file 04/18/24 18:13:01.325 Apr 18 18:13:01.325: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c losetup -d /dev/loop0] Namespace:persistent-local-volumes-test-5885 PodName:hostexec-v126-worker2-xhrqm ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:13:01.325: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:13:01.327: INFO: ExecWithOptions: Clientset creation Apr 18 18:13:01.327: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-5885/pods/hostexec-v126-worker2-xhrqm/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=losetup+-d+%2Fdev%2Floop0&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory /tmp/local-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da 04/18/24 18:13:01.536 Apr 18 18:13:01.536: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da] Namespace:persistent-local-volumes-test-5885 PodName:hostexec-v126-worker2-xhrqm ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:13:01.536: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:13:01.537: INFO: ExecWithOptions: Clientset creation Apr 18 18:13:01.537: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-5885/pods/hostexec-v126-worker2-xhrqm/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-5ec89b82-53e4-4d17-87aa-b327a9b4d0da&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:13:01.662: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-5885" for this suite. 04/18/24 18:13:01.667 << End Captured GinkgoWriter Output We don't set fsGroup on block device, skipped. In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:266 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [14.077 seconds] [sig-storage] ConfigMap should be consumable from pods in volume with mappings as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup] test/e2e/common/storage/configmap_volume.go:113 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVC test/e2e/storage/volume_metrics.go:491 should create metrics for total time taken in volume operations in P/V Controller test/e2e/storage/volume_metrics.go:480 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:13:05.635 Apr 18 18:13:05.636: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:13:05.637 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:13:05.648 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:13:05.652 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:13:05.656: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:13:05.656: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-3252" for this suite. 04/18/24 18:13:05.661 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [22.906 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: block] test/e2e/storage/persistent_volumes-local.go:195 Set fsGroup for local volume [BeforeEach] test/e2e/storage/persistent_volumes-local.go:264 should set fsGroup for one pod [Slow] test/e2e/storage/persistent_volumes-local.go:270 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:12:53.497 Apr 18 18:12:53.498: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:12:53.499 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:12:53.511 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:12:53.514 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:198 STEP: Initializing test volumes 04/18/24 18:12:53.527 STEP: Creating block device on node "v126-worker2" using path "/tmp/local-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670" 04/18/24 18:12:53.527 Apr 18 18:12:53.534: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-l9mn8" in namespace "persistent-local-volumes-test-9851" to be "running" Apr 18 18:12:53.537: INFO: Pod "hostexec-v126-worker2-l9mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 3.161855ms Apr 18 18:12:55.542: INFO: Pod "hostexec-v126-worker2-l9mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007923024s Apr 18 18:12:57.541: INFO: Pod "hostexec-v126-worker2-l9mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007568392s Apr 18 18:12:59.542: INFO: Pod "hostexec-v126-worker2-l9mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.008077611s Apr 18 18:13:01.541: INFO: Pod "hostexec-v126-worker2-l9mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.007384377s Apr 18 18:13:03.541: INFO: Pod "hostexec-v126-worker2-l9mn8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.00717179s Apr 18 18:13:05.540: INFO: Pod "hostexec-v126-worker2-l9mn8": Phase="Running", Reason="", readiness=true. Elapsed: 12.00647462s Apr 18 18:13:05.540: INFO: Pod "hostexec-v126-worker2-l9mn8" satisfied condition "running" Apr 18 18:13:05.540: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670 && dd if=/dev/zero of=/tmp/local-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670/file bs=4096 count=5120 && losetup -f /tmp/local-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670/file] Namespace:persistent-local-volumes-test-9851 PodName:hostexec-v126-worker2-l9mn8 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:13:05.540: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:13:05.542: INFO: ExecWithOptions: Clientset creation Apr 18 18:13:05.542: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-9851/pods/hostexec-v126-worker2-l9mn8/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670+%26%26+dd+if%3D%2Fdev%2Fzero+of%3D%2Ftmp%2Flocal-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670%2Ffile+bs%3D4096+count%3D5120+%26%26+losetup+-f+%2Ftmp%2Flocal-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670%2Ffile&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:13:05.767: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-9851 PodName:hostexec-v126-worker2-l9mn8 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:13:05.767: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:13:05.769: INFO: ExecWithOptions: Clientset creation Apr 18 18:13:05.769: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-9851/pods/hostexec-v126-worker2-l9mn8/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Creating local PVCs and PVs 04/18/24 18:13:05.882 Apr 18 18:13:05.883: INFO: Creating a PV followed by a PVC Apr 18 18:13:05.891: INFO: Waiting for PV local-pvbrz4g to bind to PVC pvc-v597z Apr 18 18:13:05.891: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-v597z] to have phase Bound Apr 18 18:13:05.893: INFO: PersistentVolumeClaim pvc-v597z found but phase is Pending instead of Bound. Apr 18 18:13:07.897: INFO: PersistentVolumeClaim pvc-v597z found but phase is Pending instead of Bound. Apr 18 18:13:09.901: INFO: PersistentVolumeClaim pvc-v597z found but phase is Pending instead of Bound. Apr 18 18:13:11.904: INFO: PersistentVolumeClaim pvc-v597z found but phase is Pending instead of Bound. Apr 18 18:13:13.908: INFO: PersistentVolumeClaim pvc-v597z found but phase is Pending instead of Bound. Apr 18 18:13:15.912: INFO: PersistentVolumeClaim pvc-v597z found and phase=Bound (10.021201333s) Apr 18 18:13:15.912: INFO: Waiting up to 3m0s for PersistentVolume local-pvbrz4g to have phase Bound Apr 18 18:13:15.915: INFO: PersistentVolume local-pvbrz4g found and phase=Bound (3.017756ms) [BeforeEach] Set fsGroup for local volume test/e2e/storage/persistent_volumes-local.go:264 Apr 18 18:13:15.921: INFO: We don't set fsGroup on block device, skipped. [AfterEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:13:15.922 Apr 18 18:13:15.922: INFO: Deleting PersistentVolumeClaim "pvc-v597z" Apr 18 18:13:15.927: INFO: Deleting PersistentVolume "local-pvbrz4g" Apr 18 18:13:15.932: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-9851 PodName:hostexec-v126-worker2-l9mn8 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:13:15.932: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:13:15.934: INFO: ExecWithOptions: Clientset creation Apr 18 18:13:15.934: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-9851/pods/hostexec-v126-worker2-l9mn8/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Tear down block device "/dev/loop0" on node "v126-worker2" at path /tmp/local-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670/file 04/18/24 18:13:16.107 Apr 18 18:13:16.107: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c losetup -d /dev/loop0] Namespace:persistent-local-volumes-test-9851 PodName:hostexec-v126-worker2-l9mn8 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:13:16.107: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:13:16.108: INFO: ExecWithOptions: Clientset creation Apr 18 18:13:16.108: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-9851/pods/hostexec-v126-worker2-l9mn8/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=losetup+-d+%2Fdev%2Floop0&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory /tmp/local-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670 04/18/24 18:13:16.287 Apr 18 18:13:16.287: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670] Namespace:persistent-local-volumes-test-9851 PodName:hostexec-v126-worker2-l9mn8 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:13:16.287: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:13:16.289: INFO: ExecWithOptions: Clientset creation Apr 18 18:13:16.289: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-9851/pods/hostexec-v126-worker2-l9mn8/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-b7e0fd69-8878-4484-a9a4-3eac62797670&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:13:16.396: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-9851" for this suite. 04/18/24 18:13:16.399 << End Captured GinkgoWriter Output We don't set fsGroup on block device, skipped. In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:266 ------------------------------ SSSSSSS ------------------------------ • [SLOW TEST] [14.082 seconds] [sig-storage] Projected secret should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance] test/e2e/common/storage/projected_secret.go:93 ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] [BeforeEach] test/e2e/storage/persistent_volumes-gce.go:79 should test that deleting the PV before the pod does not cause pod deletion to fail on PD detach test/e2e/storage/persistent_volumes-gce.go:144 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:13:30.493 Apr 18 18:13:30.493: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:13:30.495 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:13:30.506 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:13:30.51 [BeforeEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/storage/persistent_volumes-gce.go:79 Apr 18 18:13:30.514: INFO: Only supported for providers [gce gke] (not local) [AfterEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:13:30.515: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/storage/persistent_volumes-gce.go:113 Apr 18 18:13:30.519: INFO: AfterEach: Cleaning up test resources Apr 18 18:13:30.519: INFO: pvc is nil Apr 18 18:13:30.519: INFO: pv is nil [DeferCleanup (Each)] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pv-7860" for this suite. 04/18/24 18:13:30.519 << End Captured GinkgoWriter Output Only supported for providers [gce gke] (not local) In [BeforeEach] at: test/e2e/storage/persistent_volumes-gce.go:87 ------------------------------ SSS ------------------------------ • [SLOW TEST] [300.052 seconds] [sig-storage] Secrets Should fail non-optional pod creation due to secret object does not exist [Slow] test/e2e/common/storage/secrets_volume.go:439 ------------------------------ SSSSSS ------------------------------ • [SLOW TEST] [12.097 seconds] [sig-storage] HostPathType Directory [Slow] Should fail on mounting directory 'adir' when HostPathType is HostPathCharDev test/e2e/storage/host_path_type.go:96 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSS ------------------------------ • [SLOW TEST] [104.892 seconds] [sig-storage] PersistentVolumes-local Stress with local volumes [Serial] should be able to process many pods and reuse local volumes test/e2e/storage/persistent_volumes-local.go:534 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [49.923 seconds] [sig-storage] CSI mock volume CSI attach test using mock driver should require VolumeAttach for ephemermal volume and drivers with attachment test/e2e/storage/csi_mock_volume.go:392 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.709 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir] One pod requesting one prebound PVC should be able to mount volume and write from pod1 test/e2e/storage/persistent_volumes-local.go:241 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [267.440 seconds] [sig-storage] CSI mock volume CSI CSIDriver deployment after pod creation using non-attachable mock driver should bringup pod after deploying CSIDriver attach=false [Slow] test/e2e/storage/csi_mock_volume.go:430 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [17.219 seconds] [sig-storage] PersistentVolumes-local [Volume type: blockfswithoutformat] Set fsGroup for local volume should set fsGroup for one pod [Slow] test/e2e/storage/persistent_volumes-local.go:270 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [12.734 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-link] One pod requesting one prebound PVC should be able to mount volume and write from pod1 test/e2e/storage/persistent_volumes-local.go:241 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.185 seconds] [sig-storage] HostPathType Block Device [Slow] Should fail on mounting non-existent block device 'does-not-exist-blk-dev' when HostPathType is HostPathBlockDev test/e2e/storage/host_path_type.go:346 ------------------------------ SSSSSS ------------------------------ • [SLOW TEST] [91.818 seconds] [sig-storage] CSI mock volume storage capacity exhausted, late binding, with topology test/e2e/storage/csi_mock_volume.go:1194 ------------------------------ SSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [14.116 seconds] [sig-storage] PVC Protection Verify that scheduling of a pod that uses PVC that is being deleted fails and the pod becomes Unschedulable test/e2e/storage/pvc_protection.go:148 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.028 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 Ephemeral test/e2e/storage/volume_metrics.go:495 should create metrics for total time taken in volume operations in P/V Controller test/e2e/storage/volume_metrics.go:480 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:14:12.372 Apr 18 18:14:12.372: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:14:12.374 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:14:12.384 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:14:12.387 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:14:12.391: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:14:12.391: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-3106" for this suite. 04/18/24 18:14:12.395 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSS ------------------------------ • [SLOW TEST] [8.074 seconds] [sig-storage] HostPathType Socket [Slow] Should fail on mounting socket 'asocket' when HostPathType is HostPathFile test/e2e/storage/host_path_type.go:225 ------------------------------ SSSSSSSSS ------------------------------ • [SLOW TEST] [12.819 seconds] [sig-storage] PersistentVolumes-local [Volume type: tmpfs] Set fsGroup for local volume should set fsGroup for one pod [Slow] test/e2e/storage/persistent_volumes-local.go:270 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.207 seconds] [sig-storage] HostPathType Character Device [Slow] Should fail on mounting character device 'achardev' when HostPathType is HostPathFile test/e2e/storage/host_path_type.go:295 ------------------------------ SSSSSSSSSSS ------------------------------ • [SLOW TEST] [9.070 seconds] [sig-storage] PersistentVolumes-local Pods sharing a single local PV [Serial] all pods should be running test/e2e/storage/persistent_volumes-local.go:656 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [74.944 seconds] [sig-storage] CSI mock volume CSI NodeUnstage error cases [Slow] two pods: should call NodeStage after previous NodeUnstage final error test/e2e/storage/csi_mock_volume.go:1075 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS• ------------------------------ • [SLOW TEST] [42.933 seconds] [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity unused test/e2e/storage/csi_mock_volume.go:1413 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [13.197 seconds] [sig-storage] PersistentVolumes-local [Volume type: block] One pod requesting one prebound PVC should be able to mount volume and read from pod1 test/e2e/storage/persistent_volumes-local.go:235 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [61.992 seconds] [sig-storage] CSI mock volume CSI volume limit information using mock driver should report attach limit for generic ephemeral volume when persistent volume is attached [Slow] test/e2e/storage/csi_mock_volume.go:620 ------------------------------ SSSSSSSSSS ------------------------------ S [SKIPPED] [0.032 seconds] [sig-storage] Pod Disks [Feature:StorageProvider] [BeforeEach] test/e2e/storage/pd.go:76 schedule pods each with a PD, delete pod and verify detach [Slow] test/e2e/storage/pd.go:95 for RW PD with pod delete grace period of "default (30s)" test/e2e/storage/pd.go:137 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:15:10.268 Apr 18 18:15:10.268: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pod-disks 04/18/24 18:15:10.27 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:15:10.282 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:15:10.286 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/storage/pd.go:76 Apr 18 18:15:10.291: INFO: Requires at least 2 nodes (not -1) [AfterEach] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:15:10.291: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Pod Disks [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pod-disks-636" for this suite. 04/18/24 18:15:10.296 << End Captured GinkgoWriter Output Requires at least 2 nodes (not -1) In [BeforeEach] at: test/e2e/storage/pd.go:77 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [43.985 seconds] [sig-storage] CSI mock volume CSI Volume expansion should expand volume by restarting pod if attach=on, nodeExpansion=on test/e2e/storage/csi_mock_volume.go:700 ------------------------------ SSSSSSSSSSSS•SSSS ------------------------------ S [SKIPPED] [0.027 seconds] [sig-storage] Multi-AZ Cluster Volumes [BeforeEach] test/e2e/storage/ubernetes_lite_volumes.go:45 should schedule pods in the same zones as statically provisioned PVs test/e2e/storage/ubernetes_lite_volumes.go:56 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Multi-AZ Cluster Volumes set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:15:12.759 Apr 18 18:15:12.759: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename multi-az 04/18/24 18:15:12.76 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:15:12.771 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:15:12.774 [BeforeEach] [sig-storage] Multi-AZ Cluster Volumes test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Multi-AZ Cluster Volumes test/e2e/storage/ubernetes_lite_volumes.go:45 Apr 18 18:15:12.778: INFO: Only supported for providers [gce gke] (not local) [AfterEach] [sig-storage] Multi-AZ Cluster Volumes test/e2e/framework/node/init/init.go:32 Apr 18 18:15:12.778: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Multi-AZ Cluster Volumes test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Multi-AZ Cluster Volumes dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Multi-AZ Cluster Volumes tear down framework | framework.go:193 STEP: Destroying namespace "multi-az-2386" for this suite. 04/18/24 18:15:12.782 << End Captured GinkgoWriter Output Only supported for providers [gce gke] (not local) In [BeforeEach] at: test/e2e/storage/ubernetes_lite_volumes.go:46 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [9.245 seconds] [sig-storage] PersistentVolumes-local [Volume type: blockfswithoutformat] One pod requesting one prebound PVC should be able to mount volume and read from pod1 test/e2e/storage/persistent_volumes-local.go:235 ------------------------------ SSSSSSS•SSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [300.053 seconds] [sig-storage] Projected secret Should fail non-optional pod creation due to secret object does not exist [Slow] test/e2e/common/storage/projected_secret.go:414 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [15.377 seconds] [sig-storage] PersistentVolumes-local [Volume type: blockfswithoutformat] Set fsGroup for local volume should set same fsGroup for two pods simultaneously [Slow] test/e2e/storage/persistent_volumes-local.go:277 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [6.179 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: gce-localssd-scsi-fs] [Serial] [BeforeEach] test/e2e/storage/persistent_volumes-local.go:198 Two pods mounting a local volume at the same time test/e2e/storage/persistent_volumes-local.go:251 should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:252 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:15:21.157 Apr 18 18:15:21.157: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:15:21.159 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:15:21.169 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:15:21.173 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:198 Apr 18 18:15:21.187: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker2-78zc6" in namespace "persistent-local-volumes-test-5909" to be "running" Apr 18 18:15:21.190: INFO: Pod "hostexec-v126-worker2-78zc6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.815765ms Apr 18 18:15:23.195: INFO: Pod "hostexec-v126-worker2-78zc6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007987309s Apr 18 18:15:25.194: INFO: Pod "hostexec-v126-worker2-78zc6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.006470125s Apr 18 18:15:27.195: INFO: Pod "hostexec-v126-worker2-78zc6": Phase="Running", Reason="", readiness=true. Elapsed: 6.007586384s Apr 18 18:15:27.195: INFO: Pod "hostexec-v126-worker2-78zc6" satisfied condition "running" Apr 18 18:15:27.195: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l] Namespace:persistent-local-volumes-test-5909 PodName:hostexec-v126-worker2-78zc6 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:15:27.195: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:15:27.196: INFO: ExecWithOptions: Clientset creation Apr 18 18:15:27.196: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-5909/pods/hostexec-v126-worker2-78zc6/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=ls+-1+%2Fmnt%2Fdisks%2Fby-uuid%2Fgoogle-local-ssds-scsi-fs%2F+%7C+wc+-l&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:15:27.327: INFO: exec v126-worker2: command: ls -1 /mnt/disks/by-uuid/google-local-ssds-scsi-fs/ | wc -l Apr 18 18:15:27.327: INFO: exec v126-worker2: stdout: "0\n" Apr 18 18:15:27.327: INFO: exec v126-worker2: stderr: "ls: cannot access '/mnt/disks/by-uuid/google-local-ssds-scsi-fs/': No such file or directory\n" Apr 18 18:15:27.327: INFO: exec v126-worker2: exit code: 0 Apr 18 18:15:27.327: INFO: Requires at least 1 scsi fs localSSD [AfterEach] [Volume type: gce-localssd-scsi-fs] [Serial] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:15:27.327 [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:15:27.327: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-5909" for this suite. 04/18/24 18:15:27.332 << End Captured GinkgoWriter Output Requires at least 1 scsi fs localSSD In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:1255 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.070 seconds] [sig-storage] Projected configMap should be consumable from pods in volume with mappings as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup] test/e2e/common/storage/projected_configmap.go:113 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [40.445 seconds] [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity disabled test/e2e/storage/csi_mock_volume.go:1413 ------------------------------ SSSSSSS• ------------------------------ • [SLOW TEST] [14.095 seconds] [sig-storage] HostPathType Directory [Slow] Should fail on mounting non-existent directory 'does-not-exist-dir' when HostPathType is HostPathDirectory test/e2e/storage/host_path_type.go:72 ------------------------------ SSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [13.020 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-bindmounted] Set fsGroup for local volume should set same fsGroup for two pods simultaneously [Slow] test/e2e/storage/persistent_volumes-local.go:277 ------------------------------ SSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [15.222 seconds] [sig-storage] PersistentVolumes-local [Volume type: tmpfs] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:252 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [41.468 seconds] [sig-storage] CSI mock volume CSI volume limit information using mock driver should report attach limit for persistent volume when generic ephemeral volume is attached [Slow] test/e2e/storage/csi_mock_volume.go:645 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.032 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 Ephemeral test/e2e/storage/volume_metrics.go:495 should create prometheus metrics for volume provisioning errors [Slow] test/e2e/storage/volume_metrics.go:471 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:16:01.121 Apr 18 18:16:01.121: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:16:01.123 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:16:01.135 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:16:01.139 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:16:01.143: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:16:01.143: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-5752" for this suite. 04/18/24 18:16:01.148 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [39.447 seconds] [sig-storage] CSI mock volume CSIServiceAccountToken token should not be plumbed down when csiServiceAccountTokenEnabled=false test/e2e/storage/csi_mock_volume.go:1638 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [300.062 seconds] [sig-storage] Projected secret Should fail non-optional pod creation due to the key in the secret object does not exist [Slow] test/e2e/common/storage/projected_secret.go:424 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSS•SSS ------------------------------ • [SLOW TEST] [43.972 seconds] [sig-storage] CSI mock volume CSI workload information using mock driver should not be passed when podInfoOnMount=false test/e2e/storage/csi_mock_volume.go:549 ------------------------------ SSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.036 seconds] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] [BeforeEach] test/e2e/storage/persistent_volumes-gce.go:79 should test that deleting a PVC before the pod does not cause pod deletion to fail on PD detach test/e2e/storage/persistent_volumes-gce.go:129 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:16:17.471 Apr 18 18:16:17.471: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:16:17.473 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:16:17.483 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:16:17.488 [BeforeEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/storage/persistent_volumes-gce.go:79 Apr 18 18:16:17.497: INFO: Only supported for providers [gce gke] (not local) [AfterEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:16:17.498: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/storage/persistent_volumes-gce.go:113 Apr 18 18:16:17.502: INFO: AfterEach: Cleaning up test resources Apr 18 18:16:17.502: INFO: pvc is nil Apr 18 18:16:17.502: INFO: pv is nil [DeferCleanup (Each)] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pv-6161" for this suite. 04/18/24 18:16:17.502 << End Captured GinkgoWriter Output Only supported for providers [gce gke] (not local) In [BeforeEach] at: test/e2e/storage/persistent_volumes-gce.go:87 ------------------------------ SSS ------------------------------ S [SKIPPED] [0.028 seconds] [sig-storage] Dynamic Provisioning test/e2e/storage/utils/framework.go:23 DynamicProvisioner Default test/e2e/storage/volume_provisioning.go:601 [It] should create and delete default persistent volumes [Slow] test/e2e/storage/volume_provisioning.go:602 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] Dynamic Provisioning set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:16:17.513 Apr 18 18:16:17.513: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename volume-provisioning 04/18/24 18:16:17.514 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:16:17.525 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:16:17.529 [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] Dynamic Provisioning test/e2e/storage/volume_provisioning.go:144 [It] should create and delete default persistent volumes [Slow] test/e2e/storage/volume_provisioning.go:602 Apr 18 18:16:17.532: INFO: Only supported for providers [openstack gce aws gke vsphere azure] (not local) [AfterEach] [sig-storage] Dynamic Provisioning test/e2e/framework/node/init/init.go:32 Apr 18 18:16:17.533: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] Dynamic Provisioning tear down framework | framework.go:193 STEP: Destroying namespace "volume-provisioning-8500" for this suite. 04/18/24 18:16:17.537 << End Captured GinkgoWriter Output Only supported for providers [openstack gce aws gke vsphere azure] (not local) In [It] at: test/e2e/storage/volume_provisioning.go:603 ------------------------------ S [SKIPPED] [0.026 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 Ephemeral test/e2e/storage/volume_metrics.go:495 should create volume metrics in Volume Manager test/e2e/storage/volume_metrics.go:483 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:16:17.542 Apr 18 18:16:17.542: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:16:17.543 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:16:17.552 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:16:17.555 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:16:17.559: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:16:17.559: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-9186" for this suite. 04/18/24 18:16:17.563 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [16.761 seconds] [sig-storage] PersistentVolumes-local [Volume type: dir-link-bindmounted] One pod requesting one prebound PVC should be able to mount volume and write from pod1 test/e2e/storage/persistent_volumes-local.go:241 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVC test/e2e/storage/volume_metrics.go:491 should create volume metrics in Volume Manager test/e2e/storage/volume_metrics.go:483 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:16:17.997 Apr 18 18:16:17.997: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:16:17.999 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:16:18.01 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:16:18.014 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:16:18.018: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:16:18.018: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-8778" for this suite. 04/18/24 18:16:18.023 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ • [SLOW TEST] [37.472 seconds] [sig-storage] CSI mock volume CSI attach test using mock driver should not require VolumeAttach for drivers without attachment test/e2e/storage/csi_mock_volume.go:392 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [35.461 seconds] [sig-storage] CSI mock volume CSI workload information using mock driver should not be passed when podInfoOnMount=nil test/e2e/storage/csi_mock_volume.go:549 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.096 seconds] [sig-storage] HostPathType File [Slow] Should fail on mounting non-existent file 'does-not-exist-file' when HostPathType is HostPathFile test/e2e/storage/host_path_type.go:140 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [37.919 seconds] [sig-storage] CSI mock volume CSI attach test using mock driver should require VolumeAttach for drivers with attachment test/e2e/storage/csi_mock_volume.go:392 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [6.066 seconds] [sig-storage] HostPath should support subPath [NodeConformance] test/e2e/common/storage/host_path.go:96 ------------------------------ SSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [69.383 seconds] [sig-storage] CSI mock volume CSI NodeStage error cases [Slow] should retry NodeStage after NodeStage final error test/e2e/storage/csi_mock_volume.go:942 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [17.109 seconds] [sig-storage] PersistentVolumes-local [Volume type: tmpfs] Set fsGroup for local volume should set same fsGroup for two pods simultaneously [Slow] test/e2e/storage/persistent_volumes-local.go:277 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [191.566 seconds] [sig-storage] CSI mock volume CSI volume limit information using mock driver should report attach limit when limit is bigger than 0 [Slow] test/e2e/storage/csi_mock_volume.go:589 ------------------------------ SSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [10.997 seconds] [sig-storage] PersistentVolumes-local test/e2e/storage/utils/framework.go:23 [Volume type: block] test/e2e/storage/persistent_volumes-local.go:195 Set fsGroup for local volume [BeforeEach] test/e2e/storage/persistent_volumes-local.go:264 should set fsGroup for one pod [Slow] test/e2e/storage/persistent_volumes-local.go:270 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes-local set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:17:04.731 Apr 18 18:17:04.731: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename persistent-local-volumes-test 04/18/24 18:17:04.733 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:17:04.744 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:17:04.748 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes-local test/e2e/storage/persistent_volumes-local.go:161 [BeforeEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:198 STEP: Initializing test volumes 04/18/24 18:17:04.761 STEP: Creating block device on node "v126-worker" using path "/tmp/local-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07" 04/18/24 18:17:04.761 Apr 18 18:17:04.769: INFO: Waiting up to 5m0s for pod "hostexec-v126-worker-42mg4" in namespace "persistent-local-volumes-test-8586" to be "running" Apr 18 18:17:04.772: INFO: Pod "hostexec-v126-worker-42mg4": Phase="Pending", Reason="", readiness=false. Elapsed: 3.00693ms Apr 18 18:17:06.776: INFO: Pod "hostexec-v126-worker-42mg4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007002868s Apr 18 18:17:08.776: INFO: Pod "hostexec-v126-worker-42mg4": Phase="Running", Reason="", readiness=true. Elapsed: 4.006438074s Apr 18 18:17:08.776: INFO: Pod "hostexec-v126-worker-42mg4" satisfied condition "running" Apr 18 18:17:08.776: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07 && dd if=/dev/zero of=/tmp/local-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07/file bs=4096 count=5120 && losetup -f /tmp/local-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07/file] Namespace:persistent-local-volumes-test-8586 PodName:hostexec-v126-worker-42mg4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:17:08.776: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:17:08.777: INFO: ExecWithOptions: Clientset creation Apr 18 18:17:08.777: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-8586/pods/hostexec-v126-worker-42mg4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=mkdir+-p+%2Ftmp%2Flocal-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07+%26%26+dd+if%3D%2Fdev%2Fzero+of%3D%2Ftmp%2Flocal-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07%2Ffile+bs%3D4096+count%3D5120+%26%26+losetup+-f+%2Ftmp%2Flocal-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07%2Ffile&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) Apr 18 18:17:09.060: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-8586 PodName:hostexec-v126-worker-42mg4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:17:09.060: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:17:09.061: INFO: ExecWithOptions: Clientset creation Apr 18 18:17:09.061: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-8586/pods/hostexec-v126-worker-42mg4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Creating local PVCs and PVs 04/18/24 18:17:09.212 Apr 18 18:17:09.212: INFO: Creating a PV followed by a PVC Apr 18 18:17:09.221: INFO: Waiting for PV local-pvrrvvd to bind to PVC pvc-fwqml Apr 18 18:17:09.221: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-fwqml] to have phase Bound Apr 18 18:17:09.223: INFO: PersistentVolumeClaim pvc-fwqml found but phase is Pending instead of Bound. Apr 18 18:17:11.226: INFO: PersistentVolumeClaim pvc-fwqml found but phase is Pending instead of Bound. Apr 18 18:17:13.231: INFO: PersistentVolumeClaim pvc-fwqml found but phase is Pending instead of Bound. Apr 18 18:17:15.235: INFO: PersistentVolumeClaim pvc-fwqml found and phase=Bound (6.01455886s) Apr 18 18:17:15.235: INFO: Waiting up to 3m0s for PersistentVolume local-pvrrvvd to have phase Bound Apr 18 18:17:15.238: INFO: PersistentVolume local-pvrrvvd found and phase=Bound (3.123713ms) [BeforeEach] Set fsGroup for local volume test/e2e/storage/persistent_volumes-local.go:264 Apr 18 18:17:15.244: INFO: We don't set fsGroup on block device, skipped. [AfterEach] [Volume type: block] test/e2e/storage/persistent_volumes-local.go:207 STEP: Cleaning up PVC and PV 04/18/24 18:17:15.244 Apr 18 18:17:15.245: INFO: Deleting PersistentVolumeClaim "pvc-fwqml" Apr 18 18:17:15.250: INFO: Deleting PersistentVolume "local-pvrrvvd" Apr 18 18:17:15.257: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c E2E_LOOP_DEV=$(losetup | grep /tmp/local-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07/file | awk '{ print $1 }') 2>&1 > /dev/null && echo ${E2E_LOOP_DEV}] Namespace:persistent-local-volumes-test-8586 PodName:hostexec-v126-worker-42mg4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:17:15.257: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:17:15.258: INFO: ExecWithOptions: Clientset creation Apr 18 18:17:15.258: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-8586/pods/hostexec-v126-worker-42mg4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=E2E_LOOP_DEV%3D%24%28losetup+%7C+grep+%2Ftmp%2Flocal-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07%2Ffile+%7C+awk+%27%7B+print+%241+%7D%27%29+2%3E%261+%3E+%2Fdev%2Fnull+%26%26+echo+%24%7BE2E_LOOP_DEV%7D&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Tear down block device "/dev/loop0" on node "v126-worker" at path /tmp/local-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07/file 04/18/24 18:17:15.405 Apr 18 18:17:15.405: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c losetup -d /dev/loop0] Namespace:persistent-local-volumes-test-8586 PodName:hostexec-v126-worker-42mg4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:17:15.405: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:17:15.407: INFO: ExecWithOptions: Clientset creation Apr 18 18:17:15.407: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-8586/pods/hostexec-v126-worker-42mg4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=losetup+-d+%2Fdev%2Floop0&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) STEP: Removing the test directory /tmp/local-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07 04/18/24 18:17:15.592 Apr 18 18:17:15.592: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c rm -r /tmp/local-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07] Namespace:persistent-local-volumes-test-8586 PodName:hostexec-v126-worker-42mg4 ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false} Apr 18 18:17:15.592: INFO: >>> kubeConfig: /home/xtesting/.kube/config Apr 18 18:17:15.593: INFO: ExecWithOptions: Clientset creation Apr 18 18:17:15.593: INFO: ExecWithOptions: execute(POST https://172.30.13.90:34095/api/v1/namespaces/persistent-local-volumes-test-8586/pods/hostexec-v126-worker-42mg4/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=rm+-r+%2Ftmp%2Flocal-volume-test-15af5f84-995f-4a15-aaf4-c821cd415d07&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true) [AfterEach] [sig-storage] PersistentVolumes-local test/e2e/framework/node/init/init.go:32 Apr 18 18:17:15.718: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes-local tear down framework | framework.go:193 STEP: Destroying namespace "persistent-local-volumes-test-8586" for this suite. 04/18/24 18:17:15.723 << End Captured GinkgoWriter Output We don't set fsGroup on block device, skipped. In [BeforeEach] at: test/e2e/storage/persistent_volumes-local.go:266 ------------------------------ SSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [188.434 seconds] [sig-storage] CSI mock volume CSI NodeStage error cases [Slow] should not call NodeUnstage after NodeStage final error test/e2e/storage/csi_mock_volume.go:942 ------------------------------ SSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.032 seconds] [sig-storage] [Serial] Volume metrics [BeforeEach] test/e2e/storage/volume_metrics.go:62 PVController test/e2e/storage/volume_metrics.go:500 should create total pv count metrics for with plugin and volume mode labels after creating pv test/e2e/storage/volume_metrics.go:630 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] [Serial] Volume metrics set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:17:31.346 Apr 18 18:17:31.346: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:17:31.348 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:17:31.359 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:17:31.363 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:62 Apr 18 18:17:31.367: INFO: Only supported for providers [gce gke aws] (not local) [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/framework/node/init/init.go:32 Apr 18 18:17:31.367: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] [Serial] Volume metrics test/e2e/storage/volume_metrics.go:101 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] [Serial] Volume metrics tear down framework | framework.go:193 STEP: Destroying namespace "pv-7976" for this suite. 04/18/24 18:17:31.372 << End Captured GinkgoWriter Output Only supported for providers [gce gke aws] (not local) In [BeforeEach] at: test/e2e/storage/volume_metrics.go:70 There were additional failures detected after the initial failure. Here's a summary - for full details run Ginkgo in verbose mode: [PANICKED] in [AfterEach] at /usr/local/go/src/runtime/panic.go:260 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ S [SKIPPED] [0.031 seconds] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] [BeforeEach] test/e2e/storage/persistent_volumes-gce.go:79 should test that deleting the Namespace of a PVC and Pod causes the successful detach of Persistent Disk test/e2e/storage/persistent_volumes-gce.go:158 Begin Captured GinkgoWriter Output >> [BeforeEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] set up framework | framework.go:178 STEP: Creating a kubernetes client 04/18/24 18:17:31.406 Apr 18 18:17:31.407: INFO: >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename pv 04/18/24 18:17:31.408 STEP: Waiting for a default service account to be provisioned in namespace 04/18/24 18:17:31.419 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 04/18/24 18:17:31.423 [BeforeEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/storage/persistent_volumes-gce.go:79 Apr 18 18:17:31.427: INFO: Only supported for providers [gce gke] (not local) [AfterEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/framework/node/init/init.go:32 Apr 18 18:17:31.427: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/storage/persistent_volumes-gce.go:113 Apr 18 18:17:31.432: INFO: AfterEach: Cleaning up test resources Apr 18 18:17:31.432: INFO: pvc is nil Apr 18 18:17:31.432: INFO: pv is nil [DeferCleanup (Each)] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] dump namespaces | framework.go:196 [DeferCleanup (Each)] [sig-storage] PersistentVolumes GCEPD [Feature:StorageProvider] tear down framework | framework.go:193 STEP: Destroying namespace "pv-3272" for this suite. 04/18/24 18:17:31.432 << End Captured GinkgoWriter Output Only supported for providers [gce gke] (not local) In [BeforeEach] at: test/e2e/storage/persistent_volumes-gce.go:87 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [16.433 seconds] [sig-storage] PersistentVolumes-local Pod with node different from PV's NodeAffinity should fail scheduling due to different NodeAffinity test/e2e/storage/persistent_volumes-local.go:378 ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST] [27.942 seconds] [sig-storage] CSI mock volume CSI workload information using mock driver contain ephemeral=true when using inline volume test/e2e/storage/csi_mock_volume.go:549 ------------------------------ • [SLOW TEST] [44.979 seconds] [sig-storage] CSI mock volume CSIServiceAccountToken token should be plumbed down when csiServiceAccountTokenEnabled=true test/e2e/storage/csi_mock_volume.go:1638 ------------------------------ • [SLOW TEST] [20.389 seconds] [sig-storage] PersistentVolumes-local [Volume type: blockfswithformat] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2 test/e2e/storage/persistent_volumes-local.go:252 ------------------------------ • [SLOW TEST] [74.473 seconds] [sig-storage] CSI mock volume CSI NodeUnstage error cases [Slow] two pods: should call NodeStage after previous NodeUnstage transient error test/e2e/storage/csi_mock_volume.go:1075 ------------------------------ • [SLOW TEST] [300.050 seconds] [sig-storage] Projected configMap Should fail non-optional pod creation due to configMap object does not exist [Slow] test/e2e/common/storage/projected_configmap.go:463 ------------------------------ • [SLOW TEST] [69.445 seconds] [sig-storage] CSI mock volume CSI NodeStage error cases [Slow] should retry NodeStage after NodeStage ephemeral error test/e2e/storage/csi_mock_volume.go:942 ------------------------------ • [SLOW TEST] [159.970 seconds] [sig-storage] CSI mock volume CSI Volume expansion should not expand volume if resizingOnDriver=off, resizingOnSC=on test/e2e/storage/csi_mock_volume.go:700 ------------------------------ • [SLOW TEST] [602.111 seconds] [sig-storage] PersistentVolumes-local Local volume that cannot be mounted [Slow] should fail due to non-existent path test/e2e/storage/persistent_volumes-local.go:310 ------------------------------ • [SLOW TEST] [300.062 seconds] [sig-storage] Projected configMap Should fail non-optional pod creation due to the key in the configMap object does not exist [Slow] test/e2e/common/storage/projected_configmap.go:472 ------------------------------ Ran 170 of 7069 Specs in 1019.784 seconds SUCCESS! -- 170 Passed | 0 Failed | 0 Pending | 6899 Skipped Ginkgo ran 1 suite in 17m0.828682043s Test Suite Passed