==== start of pod log for container csi-mockplugin-attacher-0/csi-attacher ==== I0505 01:09:05.980578 1 main.go:99] Version: v3.3.0 I0505 01:09:05.988921 1 connection.go:154] Connecting to unix:///csi/csi.sock I0505 01:09:06.989959 1 common.go:111] Probing CSI driver for readiness I0505 01:09:06.989989 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0505 01:09:06.989998 1 connection.go:184] GRPC request: {} I0505 01:09:07.001129 1 connection.go:186] GRPC response: {} I0505 01:09:07.001282 1 connection.go:187] GRPC error: I0505 01:09:07.001319 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0505 01:09:07.001332 1 connection.go:184] GRPC request: {} I0505 01:09:07.002256 1 connection.go:186] GRPC response: {"name":"csi-mock-csi-mock-volumes-6393","vendor_version":"v1.7.3"} I0505 01:09:07.002396 1 connection.go:187] GRPC error: I0505 01:09:07.002416 1 main.go:155] CSI driver name: "csi-mock-csi-mock-volumes-6393" I0505 01:09:07.002432 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0505 01:09:07.002445 1 connection.go:184] GRPC request: {} I0505 01:09:07.003924 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0505 01:09:07.004181 1 connection.go:187] GRPC error: I0505 01:09:07.004194 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0505 01:09:07.004200 1 connection.go:184] GRPC request: {} I0505 01:09:07.005353 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":2}}}]} I0505 01:09:07.005564 1 connection.go:187] GRPC error: I0505 01:09:07.005636 1 main.go:230] CSI driver supports ControllerPublishUnpublish, using real CSI handler I0505 01:09:07.008058 1 controller.go:128] Starting CSI attacher I0505 01:09:07.008378 1 reflector.go:219] Starting reflector *v1.VolumeAttachment (10m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:09:07.008406 1 reflector.go:255] Listing and watching *v1.VolumeAttachment from k8s.io/client-go/informers/factory.go:134 I0505 01:09:07.008473 1 reflector.go:219] Starting reflector *v1.PersistentVolume (10m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:09:07.008502 1 reflector.go:255] Listing and watching *v1.PersistentVolume from k8s.io/client-go/informers/factory.go:134 I0505 01:09:07.008653 1 reflector.go:219] Starting reflector *v1.CSINode (10m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:09:07.008678 1 reflector.go:255] Listing and watching *v1.CSINode from k8s.io/client-go/informers/factory.go:134 I0505 01:09:07.108267 1 shared_informer.go:270] caches populated I0505 01:09:08.055277 1 controller.go:208] Started VA processing "csi-40de79be4326dc233a5bd276ea1bf02e1f8587d86f26e10155143379cca769c2" I0505 01:09:08.055312 1 controller.go:223] Skipping VolumeAttachment csi-40de79be4326dc233a5bd276ea1bf02e1f8587d86f26e10155143379cca769c2 for attacher csi-mock-csi-mock-volumes-7906 I0505 01:09:13.868446 1 controller.go:208] Started VA processing "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.868489 1 csi_handler.go:221] CSIHandler: processing VA "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.868504 1 csi_handler.go:248] Attaching "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.868520 1 csi_handler.go:427] Starting attach operation for "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.868622 1 csi_handler.go:347] Adding finalizer to PV "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" I0505 01:09:13.876526 1 csi_handler.go:356] PV finalizer added to "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" I0505 01:09:13.876568 1 csi_handler.go:746] Found NodeID v125-worker2 in CSINode v125-worker2 I0505 01:09:13.876594 1 csi_handler.go:309] VA finalizer added to "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.876620 1 csi_handler.go:323] NodeID annotation added to "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.881286 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerPublishVolume I0505 01:09:13.881308 1 connection.go:184] GRPC request: {"node_id":"v125-worker2","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"storage.kubernetes.io/csiProvisionerIdentity":"1683248947142-8081-csi-mock-csi-mock-volumes-6393"},"volume_id":"71f91ed9-eae1-11ed-8d92-42efe1483947"} I0505 01:09:13.883426 1 connection.go:186] GRPC response: {} I0505 01:09:13.883533 1 connection.go:187] GRPC error: I0505 01:09:13.883548 1 csi_handler.go:261] Attached "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.883574 1 util.go:38] Marking as attached "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.888643 1 util.go:52] Marked as attached "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.888665 1 csi_handler.go:267] Fully attached "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.888677 1 csi_handler.go:237] CSIHandler: finished processing "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.888709 1 controller.go:208] Started VA processing "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.888721 1 csi_handler.go:221] CSIHandler: processing VA "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:13.888731 1 csi_handler.go:243] "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" is already attached I0505 01:09:13.888741 1 csi_handler.go:237] CSIHandler: finished processing "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.461903 1 controller.go:208] Started VA processing "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.461955 1 csi_handler.go:221] CSIHandler: processing VA "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.461969 1 csi_handler.go:272] Starting detach operation for "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.462046 1 csi_handler.go:279] Detaching "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.462071 1 csi_handler.go:746] Found NodeID v125-worker2 in CSINode v125-worker2 I0505 01:09:57.462099 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume I0505 01:09:57.462108 1 connection.go:184] GRPC request: {"node_id":"v125-worker2","volume_id":"71f91ed9-eae1-11ed-8d92-42efe1483947"} I0505 01:09:57.463730 1 connection.go:186] GRPC response: {} I0505 01:09:57.463810 1 connection.go:187] GRPC error: I0505 01:09:57.463824 1 csi_handler.go:587] Detached "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.463873 1 util.go:80] Marking as detached "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.475866 1 controller.go:259] Started PV processing "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" I0505 01:09:57.475889 1 csi_handler.go:629] CSIHandler: processing PV "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" I0505 01:09:57.475901 1 csi_handler.go:651] CSIHandler: processing PV "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96": no deletion timestamp, ignoring I0505 01:09:57.476282 1 util.go:106] Finalizer removed from "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.476318 1 csi_handler.go:292] Fully detached "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.476335 1 csi_handler.go:237] CSIHandler: finished processing "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.476376 1 controller.go:208] Started VA processing "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" I0505 01:09:57.476412 1 controller.go:215] VA "csi-68397d00bebc162bd56ec719b1c38b34d041891f109903c52b1807133c2deab0" deleted, ignoring I0505 01:10:00.855207 1 controller.go:259] Started PV processing "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" I0505 01:10:00.855248 1 csi_handler.go:629] CSIHandler: processing PV "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" I0505 01:10:00.855290 1 csi_handler.go:690] CSIHandler: processing PV "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96": no VA found, removing finalizer E0505 01:10:00.865987 1 csi_handler.go:707] Failed to remove finalizer from PV "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96": PersistentVolume "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{"kubernetes.io/pv-protection"} I0505 01:10:00.866056 1 controller.go:259] Started PV processing "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" I0505 01:10:00.866089 1 csi_handler.go:629] CSIHandler: processing PV "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" I0505 01:10:00.866126 1 csi_handler.go:690] CSIHandler: processing PV "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96": no VA found, removing finalizer I0505 01:10:00.877052 1 csi_handler.go:712] Removed finalizer from PV "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" I0505 01:10:01.866134 1 controller.go:259] Started PV processing "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" I0505 01:10:01.866243 1 controller.go:266] PV "pvc-02342ecb-3b77-46f7-bcba-719fb0e91b96" deleted, ignoring I0505 01:10:03.900941 1 controller.go:208] Started VA processing "csi-15dda4ed25a77e3245069e2b9761662f0f0dd768dc67164b11939f86352fd183" I0505 01:10:03.900983 1 controller.go:223] Skipping VolumeAttachment csi-15dda4ed25a77e3245069e2b9761662f0f0dd768dc67164b11939f86352fd183 for attacher csi-mock-csi-mock-volumes-9426 I0505 01:10:03.915962 1 controller.go:208] Started VA processing "csi-15dda4ed25a77e3245069e2b9761662f0f0dd768dc67164b11939f86352fd183" I0505 01:10:03.915988 1 controller.go:223] Skipping VolumeAttachment csi-15dda4ed25a77e3245069e2b9761662f0f0dd768dc67164b11939f86352fd183 for attacher csi-mock-csi-mock-volumes-9426 I0505 01:10:03.923801 1 controller.go:208] Started VA processing "csi-15dda4ed25a77e3245069e2b9761662f0f0dd768dc67164b11939f86352fd183" I0505 01:10:03.923833 1 controller.go:223] Skipping VolumeAttachment csi-15dda4ed25a77e3245069e2b9761662f0f0dd768dc67164b11939f86352fd183 for attacher csi-mock-csi-mock-volumes-9426 ==== end of pod log for container csi-mockplugin-attacher-0/csi-attacher ====