==== start of pod log for container csi-mockplugin-attacher-0/csi-attacher ==== I0505 01:13:18.851174 1 main.go:99] Version: v3.3.0 I0505 01:13:18.856474 1 connection.go:154] Connecting to unix:///csi/csi.sock I0505 01:13:19.857416 1 common.go:111] Probing CSI driver for readiness I0505 01:13:19.857442 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0505 01:13:19.857449 1 connection.go:184] GRPC request: {} I0505 01:13:19.860823 1 connection.go:186] GRPC response: {} I0505 01:13:19.860897 1 connection.go:187] GRPC error: I0505 01:13:19.860912 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0505 01:13:19.860917 1 connection.go:184] GRPC request: {} I0505 01:13:19.861395 1 connection.go:186] GRPC response: {"name":"csi-mock-csi-mock-volumes-7178","vendor_version":"v1.7.3"} I0505 01:13:19.861479 1 connection.go:187] GRPC error: I0505 01:13:19.861512 1 main.go:155] CSI driver name: "csi-mock-csi-mock-volumes-7178" I0505 01:13:19.861520 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0505 01:13:19.861526 1 connection.go:184] GRPC request: {} I0505 01:13:19.862300 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0505 01:13:19.862462 1 connection.go:187] GRPC error: I0505 01:13:19.862476 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0505 01:13:19.862482 1 connection.go:184] GRPC request: {} I0505 01:13:19.863498 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":2}}}]} I0505 01:13:19.863735 1 connection.go:187] GRPC error: I0505 01:13:19.863814 1 main.go:230] CSI driver supports ControllerPublishUnpublish, using real CSI handler I0505 01:13:19.863955 1 controller.go:128] Starting CSI attacher I0505 01:13:19.864323 1 reflector.go:219] Starting reflector *v1.VolumeAttachment (10m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.864344 1 reflector.go:255] Listing and watching *v1.VolumeAttachment from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.865615 1 reflector.go:219] Starting reflector *v1.PersistentVolume (10m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.865673 1 reflector.go:255] Listing and watching *v1.PersistentVolume from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.865812 1 reflector.go:219] Starting reflector *v1.CSINode (10m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.866307 1 reflector.go:255] Listing and watching *v1.CSINode from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.964926 1 shared_informer.go:270] caches populated I0505 01:13:19.965023 1 controller.go:208] Started VA processing "csi-7a2705494ff6752124e1abdc32125cfc598cfdc9b506e36ea4c871f448b43cfb" I0505 01:13:19.965050 1 controller.go:223] Skipping VolumeAttachment csi-7a2705494ff6752124e1abdc32125cfc598cfdc9b506e36ea4c871f448b43cfb for attacher csi-mock-csi-mock-volumes-5553 I0505 01:13:21.596883 1 controller.go:208] Started VA processing "csi-7a2705494ff6752124e1abdc32125cfc598cfdc9b506e36ea4c871f448b43cfb" I0505 01:13:21.596923 1 controller.go:223] Skipping VolumeAttachment csi-7a2705494ff6752124e1abdc32125cfc598cfdc9b506e36ea4c871f448b43cfb for attacher csi-mock-csi-mock-volumes-5553 I0505 01:13:21.601493 1 controller.go:208] Started VA processing "csi-7a2705494ff6752124e1abdc32125cfc598cfdc9b506e36ea4c871f448b43cfb" I0505 01:13:21.601531 1 controller.go:223] Skipping VolumeAttachment csi-7a2705494ff6752124e1abdc32125cfc598cfdc9b506e36ea4c871f448b43cfb for attacher csi-mock-csi-mock-volumes-5553 I0505 01:13:21.608129 1 controller.go:259] Started PV processing "pvc-a8d3ed17-6ac7-4ac9-9209-ba8542ff0d8c" I0505 01:13:21.608160 1 csi_handler.go:629] CSIHandler: processing PV "pvc-a8d3ed17-6ac7-4ac9-9209-ba8542ff0d8c" I0505 01:13:21.608184 1 csi_handler.go:651] CSIHandler: processing PV "pvc-a8d3ed17-6ac7-4ac9-9209-ba8542ff0d8c": no deletion timestamp, ignoring I0505 01:13:25.012099 1 controller.go:208] Started VA processing "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.012144 1 csi_handler.go:221] CSIHandler: processing VA "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.012159 1 csi_handler.go:248] Attaching "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.012174 1 csi_handler.go:427] Starting attach operation for "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.012261 1 csi_handler.go:347] Adding finalizer to PV "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" I0505 01:13:25.022445 1 csi_handler.go:356] PV finalizer added to "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" I0505 01:13:25.022504 1 csi_handler.go:746] Found NodeID v125-worker in CSINode v125-worker I0505 01:13:25.022548 1 csi_handler.go:309] VA finalizer added to "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.022587 1 csi_handler.go:323] NodeID annotation added to "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.027432 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerPublishVolume I0505 01:13:25.027453 1 connection.go:184] GRPC request: {"node_id":"v125-worker","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"storage.kubernetes.io/csiProvisionerIdentity":"1683249199815-8081-csi-mock-csi-mock-volumes-7178"},"volume_id":"079f7f33-eae2-11ed-b0b7-8a7523753b2e"} I0505 01:13:25.029763 1 connection.go:186] GRPC response: {} I0505 01:13:25.029877 1 connection.go:187] GRPC error: I0505 01:13:25.029893 1 csi_handler.go:261] Attached "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.029908 1 util.go:38] Marking as attached "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.035309 1 util.go:52] Marked as attached "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.035345 1 csi_handler.go:267] Fully attached "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.035363 1 csi_handler.go:237] CSIHandler: finished processing "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.035421 1 controller.go:208] Started VA processing "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.035437 1 csi_handler.go:221] CSIHandler: processing VA "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:25.035454 1 csi_handler.go:243] "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" is already attached I0505 01:13:25.035489 1 csi_handler.go:237] CSIHandler: finished processing "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:35.479649 1 controller.go:208] Started VA processing "csi-e57d567b191cf03f9deef0afaf9ee92786e809b9fa1794848132b4454861dbef" I0505 01:13:35.479688 1 controller.go:223] Skipping VolumeAttachment csi-e57d567b191cf03f9deef0afaf9ee92786e809b9fa1794848132b4454861dbef for attacher csi-mock-csi-mock-volumes-6558 I0505 01:13:35.496531 1 controller.go:208] Started VA processing "csi-e57d567b191cf03f9deef0afaf9ee92786e809b9fa1794848132b4454861dbef" I0505 01:13:35.496582 1 controller.go:223] Skipping VolumeAttachment csi-e57d567b191cf03f9deef0afaf9ee92786e809b9fa1794848132b4454861dbef for attacher csi-mock-csi-mock-volumes-6558 I0505 01:13:35.503655 1 controller.go:208] Started VA processing "csi-e57d567b191cf03f9deef0afaf9ee92786e809b9fa1794848132b4454861dbef" I0505 01:13:35.503688 1 controller.go:223] Skipping VolumeAttachment csi-e57d567b191cf03f9deef0afaf9ee92786e809b9fa1794848132b4454861dbef for attacher csi-mock-csi-mock-volumes-6558 I0505 01:13:44.359319 1 controller.go:208] Started VA processing "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:44.359360 1 csi_handler.go:221] CSIHandler: processing VA "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:44.359374 1 csi_handler.go:272] Starting detach operation for "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:44.359465 1 csi_handler.go:279] Detaching "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:44.359494 1 csi_handler.go:746] Found NodeID v125-worker in CSINode v125-worker I0505 01:13:44.359521 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume I0505 01:13:44.359532 1 connection.go:184] GRPC request: {"node_id":"v125-worker","volume_id":"079f7f33-eae2-11ed-b0b7-8a7523753b2e"} I0505 01:13:44.361261 1 connection.go:186] GRPC response: {} I0505 01:13:44.361367 1 connection.go:187] GRPC error: I0505 01:13:44.361380 1 csi_handler.go:587] Detached "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:44.361423 1 util.go:80] Marking as detached "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:44.374705 1 controller.go:259] Started PV processing "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" I0505 01:13:44.374733 1 csi_handler.go:629] CSIHandler: processing PV "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" I0505 01:13:44.374754 1 csi_handler.go:651] CSIHandler: processing PV "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": no deletion timestamp, ignoring I0505 01:13:44.374834 1 util.go:106] Finalizer removed from "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:44.374864 1 csi_handler.go:292] Fully detached "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:44.374879 1 csi_handler.go:237] CSIHandler: finished processing "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:44.374934 1 controller.go:208] Started VA processing "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" I0505 01:13:44.374971 1 controller.go:215] VA "csi-c521213fb2f2830696252172b741b8efefc9612028eefa4aa80c06f72d04f6ee" deleted, ignoring I0505 01:13:45.075950 1 controller.go:259] Started PV processing "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" I0505 01:13:45.075994 1 csi_handler.go:629] CSIHandler: processing PV "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" I0505 01:13:45.076113 1 csi_handler.go:690] CSIHandler: processing PV "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": no VA found, removing finalizer E0505 01:13:45.086962 1 csi_handler.go:707] Failed to remove finalizer from PV "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": PersistentVolume "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{"kubernetes.io/pv-protection"} I0505 01:13:45.087053 1 controller.go:259] Started PV processing "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" I0505 01:13:45.087082 1 csi_handler.go:629] CSIHandler: processing PV "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" I0505 01:13:45.087137 1 csi_handler.go:690] CSIHandler: processing PV "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": no VA found, removing finalizer I0505 01:13:45.095298 1 csi_handler.go:712] Removed finalizer from PV "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" I0505 01:13:46.087609 1 controller.go:259] Started PV processing "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" I0505 01:13:46.087675 1 controller.go:266] PV "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" deleted, ignoring I0505 01:13:47.271469 1 controller.go:208] Started VA processing "csi-7d979e8da2e4fb6f08d604ea9bfbeb002657e3619f6293d8bb80ae44249c00ed" I0505 01:13:47.271508 1 controller.go:223] Skipping VolumeAttachment csi-7d979e8da2e4fb6f08d604ea9bfbeb002657e3619f6293d8bb80ae44249c00ed for attacher csi-mock-csi-mock-volumes-7611 I0505 01:13:47.285768 1 controller.go:208] Started VA processing "csi-7d979e8da2e4fb6f08d604ea9bfbeb002657e3619f6293d8bb80ae44249c00ed" I0505 01:13:47.285799 1 controller.go:223] Skipping VolumeAttachment csi-7d979e8da2e4fb6f08d604ea9bfbeb002657e3619f6293d8bb80ae44249c00ed for attacher csi-mock-csi-mock-volumes-7611 I0505 01:13:47.295473 1 controller.go:208] Started VA processing "csi-7d979e8da2e4fb6f08d604ea9bfbeb002657e3619f6293d8bb80ae44249c00ed" I0505 01:13:47.295511 1 controller.go:223] Skipping VolumeAttachment csi-7d979e8da2e4fb6f08d604ea9bfbeb002657e3619f6293d8bb80ae44249c00ed for attacher csi-mock-csi-mock-volumes-7611 ==== end of pod log for container csi-mockplugin-attacher-0/csi-attacher ====