==== start of pod log for container csi-mockplugin-attacher-0/csi-attacher ====
I0618 00:09:39.642245       1 main.go:91] Version: v2.2.0-0-g97411fa7
I0618 00:09:39.643797       1 connection.go:153] Connecting to unix:///csi/csi.sock
I0618 00:09:40.646800       1 common.go:111] Probing CSI driver for readiness
I0618 00:09:40.646842       1 connection.go:182] GRPC call: /csi.v1.Identity/Probe
I0618 00:09:40.646852       1 connection.go:183] GRPC request: {}
I0618 00:09:40.649079       1 connection.go:185] GRPC response: {"ready":{"value":true}}
I0618 00:09:40.649442       1 connection.go:186] GRPC error: <nil>
I0618 00:09:40.649454       1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginInfo
I0618 00:09:40.649462       1 connection.go:183] GRPC request: {}
I0618 00:09:40.649975       1 connection.go:185] GRPC response: {"manifest":{"url":"https://github.com/kubernetes-csi/csi-test/mock"},"name":"csi-mock-csi-mock-volumes-638","vendor_version":"0.3.0"}
I0618 00:09:40.650340       1 connection.go:186] GRPC error: <nil>
I0618 00:09:40.650347       1 main.go:136] CSI driver name: "csi-mock-csi-mock-volumes-638"
W0618 00:09:40.650356       1 metrics.go:142] metrics endpoint will not be started because `metrics-address` was not specified.
I0618 00:09:40.650361       1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginCapabilities
I0618 00:09:40.650365       1 connection.go:183] GRPC request: {}
I0618 00:09:40.651091       1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]}
I0618 00:09:40.652744       1 connection.go:186] GRPC error: <nil>
I0618 00:09:40.652751       1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I0618 00:09:40.652756       1 connection.go:183] GRPC request: {}
I0618 00:09:40.653464       1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]}
I0618 00:09:40.657792       1 connection.go:186] GRPC error: <nil>
I0618 00:09:40.657844       1 main.go:162] CSI driver supports ControllerPublishUnpublish, using real CSI handler
I0618 00:09:40.657852       1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I0618 00:09:40.657855       1 connection.go:183] GRPC request: {}
I0618 00:09:40.658415       1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]}
I0618 00:09:40.662112       1 connection.go:186] GRPC error: <nil>
I0618 00:09:40.662127       1 main.go:175] CSI driver supports list volumes published nodes. Using capability to reconcile volume attachment objects with actual backend state
I0618 00:09:40.662248       1 controller.go:121] Starting CSI attacher
I0618 00:09:40.662483       1 reflector.go:153] Starting reflector *v1beta1.VolumeAttachment (10m0s) from k8s.io/client-go/informers/factory.go:135
I0618 00:09:40.662499       1 reflector.go:188] Listing and watching *v1beta1.VolumeAttachment from k8s.io/client-go/informers/factory.go:135
I0618 00:09:40.662507       1 reflector.go:153] Starting reflector *v1.PersistentVolume (10m0s) from k8s.io/client-go/informers/factory.go:135
I0618 00:09:40.662507       1 reflector.go:153] Starting reflector *v1beta1.CSINode (10m0s) from k8s.io/client-go/informers/factory.go:135
I0618 00:09:40.662518       1 reflector.go:188] Listing and watching *v1.PersistentVolume from k8s.io/client-go/informers/factory.go:135
I0618 00:09:40.662522       1 reflector.go:188] Listing and watching *v1beta1.CSINode from k8s.io/client-go/informers/factory.go:135
I0618 00:09:40.762649       1 shared_informer.go:227] caches populated
I0618 00:09:40.762700       1 csi_handler.go:116] Reconciling VolumeAttachments with driver backend state
I0618 00:09:40.762741       1 controller.go:198] Started VA processing "csi-55044bbcb1c8e0a8a1b31b5da36a7f7dcacbdc59ed14bdec8e4b8ada03c6d845"
I0618 00:09:40.762751       1 controller.go:213] Skipping VolumeAttachment csi-55044bbcb1c8e0a8a1b31b5da36a7f7dcacbdc59ed14bdec8e4b8ada03c6d845 for attacher csi-mock-csi-mock-volumes-1838
I0618 00:09:40.762768       1 controller.go:198] Started VA processing "csi-ac0944972e519fa39ff6b04de3bf7b2e3881c4dbfc1fd7432bc3fd7b589a6bd3"
I0618 00:09:40.762779       1 controller.go:213] Skipping VolumeAttachment csi-ac0944972e519fa39ff6b04de3bf7b2e3881c4dbfc1fd7432bc3fd7b589a6bd3 for attacher csi-mock-csi-mock-volumes-5611
I0618 00:09:40.762759       1 connection.go:182] GRPC call: /csi.v1.Controller/ListVolumes
I0618 00:09:40.762800       1 connection.go:183] GRPC request: {}
I0618 00:09:40.763714       1 connection.go:185] GRPC response: {"entries":[{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-638"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 1"},"volume_id":"1"}},{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-638"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 2"},"volume_id":"2"}},{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-638"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 3"},"volume_id":"3"}}]}
I0618 00:09:40.766519       1 connection.go:186] GRPC error: <nil>
W0618 00:09:40.766539       1 csi_handler.go:159] Failed to repair volume handle  for driver csi-mock-csi-mock-volumes-5611: could not find In-Tree driver name for CSI plugin csi-mock-csi-mock-volumes-5611
W0618 00:09:40.766547       1 csi_handler.go:159] Failed to repair volume handle  for driver csi-mock-csi-mock-volumes-1838: could not find In-Tree driver name for CSI plugin csi-mock-csi-mock-volumes-1838
I0618 00:09:52.251883       1 controller.go:198] Started VA processing "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.251909       1 csi_handler.go:209] CSIHandler: processing VA "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.251917       1 csi_handler.go:236] Attaching "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.251927       1 csi_handler.go:396] Starting attach operation for "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.251988       1 csi_handler.go:335] Adding finalizer to PV "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2"
I0618 00:09:52.260735       1 csi_handler.go:344] PV finalizer added to "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2"
I0618 00:09:52.260754       1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-638 in CSINode node2
I0618 00:09:52.260770       1 csi_handler.go:297] VA finalizer added to "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.260777       1 csi_handler.go:311] NodeID annotation added to "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.264541       1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0618 00:09:52.264553       1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-638","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2","storage.kubernetes.io/csiProvisionerIdentity":"1655510981413-8081-csi-mock-csi-mock-volumes-638"},"volume_id":"4"}
I0618 00:09:52.266111       1 connection.go:185] GRPC response: {"publish_context":{"device":"/dev/mock","readonly":"false"}}
I0618 00:09:52.266443       1 connection.go:186] GRPC error: <nil>
I0618 00:09:52.266449       1 csi_handler.go:249] Attached "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.266456       1 util.go:35] Marking as attached "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.270639       1 util.go:48] Marked as attached "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.270684       1 csi_handler.go:255] Fully attached "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.270741       1 csi_handler.go:225] CSIHandler: finished processing "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.271088       1 controller.go:198] Started VA processing "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.271111       1 csi_handler.go:209] CSIHandler: processing VA "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.271123       1 csi_handler.go:231] "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78" is already attached
I0618 00:09:52.271134       1 csi_handler.go:225] CSIHandler: finished processing "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:09:52.854946       1 controller.go:198] Started VA processing "csi-cc6bef8facc3f1b9d0d05e703a58655b3bd6e857e5a9aa21a069395c2bf16d2b"
I0618 00:09:52.854961       1 controller.go:213] Skipping VolumeAttachment csi-cc6bef8facc3f1b9d0d05e703a58655b3bd6e857e5a9aa21a069395c2bf16d2b for attacher csi-mock-csi-mock-volumes-1150
I0618 00:09:52.863758       1 controller.go:198] Started VA processing "csi-cc6bef8facc3f1b9d0d05e703a58655b3bd6e857e5a9aa21a069395c2bf16d2b"
I0618 00:09:52.863778       1 controller.go:213] Skipping VolumeAttachment csi-cc6bef8facc3f1b9d0d05e703a58655b3bd6e857e5a9aa21a069395c2bf16d2b for attacher csi-mock-csi-mock-volumes-1150
I0618 00:09:52.869635       1 controller.go:198] Started VA processing "csi-cc6bef8facc3f1b9d0d05e703a58655b3bd6e857e5a9aa21a069395c2bf16d2b"
I0618 00:09:52.869671       1 controller.go:213] Skipping VolumeAttachment csi-cc6bef8facc3f1b9d0d05e703a58655b3bd6e857e5a9aa21a069395c2bf16d2b for attacher csi-mock-csi-mock-volumes-1150
I0618 00:10:11.896869       1 controller.go:198] Started VA processing "csi-cc6bef8facc3f1b9d0d05e703a58655b3bd6e857e5a9aa21a069395c2bf16d2b"
I0618 00:10:11.896891       1 controller.go:213] Skipping VolumeAttachment csi-cc6bef8facc3f1b9d0d05e703a58655b3bd6e857e5a9aa21a069395c2bf16d2b for attacher csi-mock-csi-mock-volumes-1150
I0618 00:10:11.904897       1 controller.go:198] Started VA processing "csi-55044bbcb1c8e0a8a1b31b5da36a7f7dcacbdc59ed14bdec8e4b8ada03c6d845"
I0618 00:10:11.904921       1 controller.go:213] Skipping VolumeAttachment csi-55044bbcb1c8e0a8a1b31b5da36a7f7dcacbdc59ed14bdec8e4b8ada03c6d845 for attacher csi-mock-csi-mock-volumes-1838
I0618 00:10:11.909467       1 controller.go:232] Started PV processing "pvc-8e7324dc-2cc2-4a7b-9a9f-b5cd33ed8a7f"
I0618 00:10:11.909486       1 csi_handler.go:591] CSIHandler: processing PV "pvc-8e7324dc-2cc2-4a7b-9a9f-b5cd33ed8a7f"
I0618 00:10:11.909493       1 csi_handler.go:595] CSIHandler: processing PV "pvc-8e7324dc-2cc2-4a7b-9a9f-b5cd33ed8a7f": no deletion timestamp, ignoring
I0618 00:10:11.915657       1 controller.go:232] Started PV processing "pvc-85515190-e3b0-4e46-b5b9-8f56e439fd46"
I0618 00:10:11.915672       1 csi_handler.go:591] CSIHandler: processing PV "pvc-85515190-e3b0-4e46-b5b9-8f56e439fd46"
I0618 00:10:11.915685       1 csi_handler.go:595] CSIHandler: processing PV "pvc-85515190-e3b0-4e46-b5b9-8f56e439fd46": no deletion timestamp, ignoring
I0618 00:10:40.767008       1 csi_handler.go:116] Reconciling VolumeAttachments with driver backend state
I0618 00:10:40.767056       1 connection.go:182] GRPC call: /csi.v1.Controller/ListVolumes
I0618 00:10:40.767064       1 connection.go:183] GRPC request: {}
I0618 00:10:40.768005       1 connection.go:185] GRPC response: {"entries":[{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-638"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 1"},"volume_id":"1"}},{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-638"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 2"},"volume_id":"2"}},{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-638"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 3"},"volume_id":"3"}},{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-638"]},"volume":{"capacity_bytes":6442450944,"volume_context":{"csi-mock-csi-mock-volumes-638/dev":"/dev/mock","csi-mock-csi-mock-volumes-638/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2/globalmount":"/dev/mock","csi-mock-csi-mock-volumes-638/var/lib/kubelet/pods/37019f93-c4be-477e-959a-e6f43d9fe280/volumes/kubernetes.io~csi/pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2/mount":"/var/lib/kubelet/pods/37019f93-c4be-477e-959a-e6f43d9fe280/volumes/kubernetes.io~csi/pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2/mount","name":"pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2","readonly":"false"},"volume_id":"4"}}]}
I0618 00:10:40.772781       1 connection.go:186] GRPC error: <nil>
W0618 00:10:40.772798       1 csi_handler.go:159] Failed to repair volume handle  for driver csi-mock-csi-mock-volumes-5611: could not find In-Tree driver name for CSI plugin csi-mock-csi-mock-volumes-5611
W0618 00:10:40.772811       1 csi_handler.go:159] Failed to repair volume handle  for driver csi-mock-csi-mock-volumes-638: could not find In-Tree driver name for CSI plugin csi-mock-csi-mock-volumes-638
I0618 00:11:22.725507       1 controller.go:198] Started VA processing "csi-ac0944972e519fa39ff6b04de3bf7b2e3881c4dbfc1fd7432bc3fd7b589a6bd3"
I0618 00:11:22.725530       1 controller.go:213] Skipping VolumeAttachment csi-ac0944972e519fa39ff6b04de3bf7b2e3881c4dbfc1fd7432bc3fd7b589a6bd3 for attacher csi-mock-csi-mock-volumes-5611
I0618 00:11:22.737050       1 controller.go:232] Started PV processing "pvc-fd0baaa3-025a-4746-b8b8-d70021b97950"
I0618 00:11:22.737072       1 csi_handler.go:591] CSIHandler: processing PV "pvc-fd0baaa3-025a-4746-b8b8-d70021b97950"
I0618 00:11:22.737081       1 csi_handler.go:595] CSIHandler: processing PV "pvc-fd0baaa3-025a-4746-b8b8-d70021b97950": no deletion timestamp, ignoring
I0618 00:11:30.472586       1 controller.go:198] Started VA processing "csi-376d868ac4294203f99677c286cf39913eca5a4050d715ce5534672dc302effb"
I0618 00:11:30.472620       1 controller.go:213] Skipping VolumeAttachment csi-376d868ac4294203f99677c286cf39913eca5a4050d715ce5534672dc302effb for attacher csi-mock-csi-mock-volumes-8225
I0618 00:11:30.480923       1 controller.go:198] Started VA processing "csi-376d868ac4294203f99677c286cf39913eca5a4050d715ce5534672dc302effb"
I0618 00:11:30.480936       1 controller.go:213] Skipping VolumeAttachment csi-376d868ac4294203f99677c286cf39913eca5a4050d715ce5534672dc302effb for attacher csi-mock-csi-mock-volumes-8225
I0618 00:11:30.486988       1 controller.go:198] Started VA processing "csi-376d868ac4294203f99677c286cf39913eca5a4050d715ce5534672dc302effb"
I0618 00:11:30.487029       1 controller.go:213] Skipping VolumeAttachment csi-376d868ac4294203f99677c286cf39913eca5a4050d715ce5534672dc302effb for attacher csi-mock-csi-mock-volumes-8225
I0618 00:11:32.806185       1 controller.go:198] Started VA processing "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:11:32.806201       1 csi_handler.go:209] CSIHandler: processing VA "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:11:32.806207       1 csi_handler.go:260] Starting detach operation for "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:11:32.806228       1 csi_handler.go:267] Detaching "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:11:32.806255       1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-638 in CSINode node2
I0618 00:11:32.806287       1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0618 00:11:32.806292       1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-638","volume_id":"4"}
I0618 00:11:32.808220       1 connection.go:185] GRPC response: {}
I0618 00:11:32.808532       1 connection.go:186] GRPC error: <nil>
I0618 00:11:32.808540       1 csi_handler.go:549] Detached "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:11:32.808560       1 util.go:76] Marking as detached "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:11:32.816821       1 controller.go:232] Started PV processing "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2"
I0618 00:11:32.816836       1 csi_handler.go:591] CSIHandler: processing PV "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2"
I0618 00:11:32.816843       1 csi_handler.go:595] CSIHandler: processing PV "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2": no deletion timestamp, ignoring
I0618 00:11:32.816851       1 util.go:90] Finalizer removed from "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:11:32.816869       1 csi_handler.go:280] Fully detached "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:11:32.816879       1 csi_handler.go:225] CSIHandler: finished processing "csi-4ae94a38c85ed44f6330bfd130a182c42cd521c5050607e97de1da3d232fcb78"
I0618 00:11:33.211814       1 controller.go:232] Started PV processing "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2"
I0618 00:11:33.211828       1 csi_handler.go:591] CSIHandler: processing PV "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2"
I0618 00:11:33.211846       1 csi_handler.go:633] CSIHandler: processing PV "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2": no VA found, removing finalizer
E0618 00:11:33.217114       1 csi_handler.go:650] Failed to remove finalizer from PV "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2": PersistentVolume "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{"kubernetes.io/pv-protection"}
I0618 00:11:33.217148       1 controller.go:232] Started PV processing "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2"
I0618 00:11:33.217161       1 csi_handler.go:591] CSIHandler: processing PV "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2"
I0618 00:11:33.217176       1 csi_handler.go:633] CSIHandler: processing PV "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2": no VA found, removing finalizer
I0618 00:11:33.222663       1 csi_handler.go:655] Removed finalizer from PV "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2"
I0618 00:11:34.217279       1 controller.go:232] Started PV processing "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2"
I0618 00:11:34.217322       1 controller.go:239] PV "pvc-15da9e2b-2aac-44a1-bde9-c732477bc5c2" deleted, ignoring
==== end of pod log for container csi-mockplugin-attacher-0/csi-attacher ====