==== start of pod log for container csi-mockplugin-attacher-0/csi-attacher ==== I0411 18:12:21.077988 1 main.go:94] Version: v4.0.0 I0411 18:12:21.082858 1 connection.go:154] Connecting to unix:///csi/csi.sock I0411 18:12:22.084768 1 common.go:111] Probing CSI driver for readiness I0411 18:12:22.084796 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0411 18:12:22.084804 1 connection.go:184] GRPC request: {} I0411 18:12:22.094966 1 connection.go:186] GRPC response: {} I0411 18:12:22.095083 1 connection.go:187] GRPC error: I0411 18:12:22.095108 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0411 18:12:22.095117 1 connection.go:184] GRPC request: {} I0411 18:12:22.096166 1 connection.go:186] GRPC response: {"name":"csi-mock-csi-mock-volumes-8194","vendor_version":"v1.9.0"} I0411 18:12:22.096291 1 connection.go:187] GRPC error: I0411 18:12:22.096310 1 main.go:150] CSI driver name: "csi-mock-csi-mock-volumes-8194" I0411 18:12:22.096323 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0411 18:12:22.096333 1 connection.go:184] GRPC request: {} I0411 18:12:22.097706 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0411 18:12:22.097963 1 connection.go:187] GRPC error: I0411 18:12:22.097980 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0411 18:12:22.097988 1 connection.go:184] GRPC request: {} I0411 18:12:22.099061 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":13}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":2}}}]} I0411 18:12:22.099353 1 connection.go:187] GRPC error: I0411 18:12:22.099437 1 main.go:226] CSI driver supports ControllerPublishUnpublish, using real CSI handler I0411 18:12:22.100573 1 controller.go:130] Starting CSI attacher I0411 18:12:22.101855 1 reflector.go:221] Starting reflector *v1.CSINode (10m0s) from k8s.io/client-go/informers/factory.go:134 I0411 18:12:22.101897 1 reflector.go:257] Listing and watching *v1.CSINode from k8s.io/client-go/informers/factory.go:134 I0411 18:12:22.101859 1 reflector.go:221] Starting reflector *v1.VolumeAttachment (10m0s) from k8s.io/client-go/informers/factory.go:134 I0411 18:12:22.101918 1 reflector.go:257] Listing and watching *v1.VolumeAttachment from k8s.io/client-go/informers/factory.go:134 I0411 18:12:22.101971 1 reflector.go:221] Starting reflector *v1.PersistentVolume (10m0s) from k8s.io/client-go/informers/factory.go:134 I0411 18:12:22.102017 1 reflector.go:257] Listing and watching *v1.PersistentVolume from k8s.io/client-go/informers/factory.go:134 I0411 18:12:22.201009 1 shared_informer.go:285] caches populated I0411 18:12:31.387223 1 controller.go:210] Started VA processing "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.387258 1 csi_handler.go:224] CSIHandler: processing VA "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.387266 1 csi_handler.go:251] Attaching "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.387274 1 csi_handler.go:421] Starting attach operation for "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.387343 1 csi_handler.go:341] Adding finalizer to PV "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" I0411 18:12:31.395664 1 csi_handler.go:350] PV finalizer added to "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" I0411 18:12:31.395700 1 csi_handler.go:740] Found NodeID v126-worker2 in CSINode v126-worker2 I0411 18:12:31.395740 1 csi_handler.go:312] VA finalizer added to "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.395753 1 csi_handler.go:326] NodeID annotation added to "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.401848 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerPublishVolume I0411 18:12:31.401870 1 connection.go:184] GRPC request: {"node_id":"v126-worker2","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":7}},"volume_context":{"storage.kubernetes.io/csiProvisionerIdentity":"1712859142258-8081-csi-mock-csi-mock-volumes-8194"},"volume_id":"0efb3b36-f82f-11ee-883a-4e12a77c068a"} I0411 18:12:31.403339 1 connection.go:186] GRPC response: {} I0411 18:12:31.403404 1 connection.go:187] GRPC error: I0411 18:12:31.403412 1 csi_handler.go:264] Attached "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.403420 1 util.go:38] Marking as attached "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.409009 1 util.go:52] Marked as attached "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.409027 1 csi_handler.go:270] Fully attached "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.409035 1 csi_handler.go:240] CSIHandler: finished processing "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.409072 1 controller.go:210] Started VA processing "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.409081 1 csi_handler.go:224] CSIHandler: processing VA "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:31.409088 1 csi_handler.go:246] "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" is already attached I0411 18:12:31.409095 1 csi_handler.go:240] CSIHandler: finished processing "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:12:48.407251 1 controller.go:210] Started VA processing "csi-1e99e5c9395da0a776992caae1bbfc4e719901b7b8140849cfc2ae2f3a37b75f" I0411 18:12:48.407305 1 controller.go:225] Skipping VolumeAttachment csi-1e99e5c9395da0a776992caae1bbfc4e719901b7b8140849cfc2ae2f3a37b75f for attacher csi-mock-csi-mock-volumes-7199 I0411 18:12:48.423743 1 controller.go:210] Started VA processing "csi-1e99e5c9395da0a776992caae1bbfc4e719901b7b8140849cfc2ae2f3a37b75f" I0411 18:12:48.423768 1 controller.go:225] Skipping VolumeAttachment csi-1e99e5c9395da0a776992caae1bbfc4e719901b7b8140849cfc2ae2f3a37b75f for attacher csi-mock-csi-mock-volumes-7199 I0411 18:12:48.431205 1 controller.go:210] Started VA processing "csi-1e99e5c9395da0a776992caae1bbfc4e719901b7b8140849cfc2ae2f3a37b75f" I0411 18:12:48.431243 1 controller.go:225] Skipping VolumeAttachment csi-1e99e5c9395da0a776992caae1bbfc4e719901b7b8140849cfc2ae2f3a37b75f for attacher csi-mock-csi-mock-volumes-7199 I0411 18:13:12.204581 1 controller.go:210] Started VA processing "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:13:12.204620 1 csi_handler.go:224] CSIHandler: processing VA "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:13:12.204632 1 csi_handler.go:275] Starting detach operation for "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:13:12.204680 1 csi_handler.go:282] Detaching "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:13:12.204710 1 csi_handler.go:740] Found NodeID v126-worker2 in CSINode v126-worker2 I0411 18:13:12.204741 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume I0411 18:13:12.204807 1 connection.go:184] GRPC request: {"node_id":"v126-worker2","volume_id":"0efb3b36-f82f-11ee-883a-4e12a77c068a"} I0411 18:13:12.206456 1 connection.go:186] GRPC response: {} I0411 18:13:12.206556 1 connection.go:187] GRPC error: I0411 18:13:12.206577 1 csi_handler.go:581] Detached "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:13:12.206734 1 util.go:80] Marking as detached "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:13:12.219611 1 controller.go:210] Started VA processing "csi-1e99e5c9395da0a776992caae1bbfc4e719901b7b8140849cfc2ae2f3a37b75f" I0411 18:13:12.219639 1 controller.go:225] Skipping VolumeAttachment csi-1e99e5c9395da0a776992caae1bbfc4e719901b7b8140849cfc2ae2f3a37b75f for attacher csi-mock-csi-mock-volumes-7199 I0411 18:13:12.221339 1 util.go:106] Finalizer removed from "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:13:12.221373 1 csi_handler.go:295] Fully detached "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:13:12.221387 1 csi_handler.go:240] CSIHandler: finished processing "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:13:12.221424 1 controller.go:210] Started VA processing "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" I0411 18:13:12.221462 1 controller.go:217] VA "csi-688f1b5b9129498f64fedb0567a751c04ac86b81f12843dd88f207d5629e1a49" deleted, ignoring I0411 18:13:12.221465 1 controller.go:261] Started PV processing "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" I0411 18:13:12.221513 1 csi_handler.go:623] CSIHandler: processing PV "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" I0411 18:13:12.221534 1 csi_handler.go:645] CSIHandler: processing PV "pvc-52f78dbf-a680-4f39-9747-e95454649ec0": no deletion timestamp, ignoring I0411 18:13:12.228499 1 controller.go:210] Started VA processing "csi-1e99e5c9395da0a776992caae1bbfc4e719901b7b8140849cfc2ae2f3a37b75f" I0411 18:13:12.228540 1 controller.go:225] Skipping VolumeAttachment csi-1e99e5c9395da0a776992caae1bbfc4e719901b7b8140849cfc2ae2f3a37b75f for attacher csi-mock-csi-mock-volumes-7199 I0411 18:13:12.235619 1 controller.go:261] Started PV processing "pvc-cba65d76-5778-4e47-922d-7aae5524c0cf" I0411 18:13:12.235652 1 csi_handler.go:623] CSIHandler: processing PV "pvc-cba65d76-5778-4e47-922d-7aae5524c0cf" I0411 18:13:12.235667 1 csi_handler.go:645] CSIHandler: processing PV "pvc-cba65d76-5778-4e47-922d-7aae5524c0cf": no deletion timestamp, ignoring I0411 18:13:13.461991 1 controller.go:261] Started PV processing "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" I0411 18:13:13.462030 1 csi_handler.go:623] CSIHandler: processing PV "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" I0411 18:13:13.462061 1 csi_handler.go:684] CSIHandler: processing PV "pvc-52f78dbf-a680-4f39-9747-e95454649ec0": no VA found, removing finalizer E0411 18:13:13.473444 1 csi_handler.go:701] Failed to remove finalizer from PV "pvc-52f78dbf-a680-4f39-9747-e95454649ec0": PersistentVolume "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{"kubernetes.io/pv-protection"} I0411 18:13:13.473518 1 controller.go:261] Started PV processing "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" I0411 18:13:13.473534 1 csi_handler.go:623] CSIHandler: processing PV "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" I0411 18:13:13.473572 1 csi_handler.go:684] CSIHandler: processing PV "pvc-52f78dbf-a680-4f39-9747-e95454649ec0": no VA found, removing finalizer I0411 18:13:13.482003 1 csi_handler.go:706] Removed finalizer from PV "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" I0411 18:13:14.473600 1 controller.go:261] Started PV processing "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" I0411 18:13:14.473653 1 controller.go:268] PV "pvc-52f78dbf-a680-4f39-9747-e95454649ec0" deleted, ignoring ==== end of pod log for container csi-mockplugin-attacher-0/csi-attacher ====