==== start of pod log for container csi-mockplugin-attacher-0/csi-attacher ====
I0618 00:12:30.022038       1 main.go:91] Version: v2.2.0-0-g97411fa7
I0618 00:12:30.023310       1 connection.go:153] Connecting to unix:///csi/csi.sock
I0618 00:12:33.113615       1 common.go:111] Probing CSI driver for readiness
I0618 00:12:33.113640       1 connection.go:182] GRPC call: /csi.v1.Identity/Probe
I0618 00:12:33.113647       1 connection.go:183] GRPC request: {}
I0618 00:12:33.117037       1 connection.go:185] GRPC response: {"ready":{"value":true}}
I0618 00:12:33.117421       1 connection.go:186] GRPC error: <nil>
I0618 00:12:33.117436       1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginInfo
I0618 00:12:33.117444       1 connection.go:183] GRPC request: {}
I0618 00:12:33.117963       1 connection.go:185] GRPC response: {"manifest":{"url":"https://github.com/kubernetes-csi/csi-test/mock"},"name":"csi-mock-csi-mock-volumes-4040","vendor_version":"0.3.0"}
I0618 00:12:33.118299       1 connection.go:186] GRPC error: <nil>
I0618 00:12:33.118311       1 main.go:136] CSI driver name: "csi-mock-csi-mock-volumes-4040"
W0618 00:12:33.118324       1 metrics.go:142] metrics endpoint will not be started because `metrics-address` was not specified.
I0618 00:12:33.118334       1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginCapabilities
I0618 00:12:33.118340       1 connection.go:183] GRPC request: {}
I0618 00:12:33.118911       1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]}
I0618 00:12:33.119777       1 connection.go:186] GRPC error: <nil>
I0618 00:12:33.119784       1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I0618 00:12:33.119788       1 connection.go:183] GRPC request: {}
I0618 00:12:33.123177       1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]}
I0618 00:12:33.127183       1 connection.go:186] GRPC error: <nil>
I0618 00:12:33.127351       1 main.go:162] CSI driver supports ControllerPublishUnpublish, using real CSI handler
I0618 00:12:33.127360       1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I0618 00:12:33.127364       1 connection.go:183] GRPC request: {}
I0618 00:12:33.128091       1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]}
I0618 00:12:33.132399       1 connection.go:186] GRPC error: <nil>
I0618 00:12:33.132415       1 main.go:175] CSI driver supports list volumes published nodes. Using capability to reconcile volume attachment objects with actual backend state
I0618 00:12:33.132551       1 controller.go:121] Starting CSI attacher
I0618 00:12:33.132766       1 reflector.go:153] Starting reflector *v1beta1.VolumeAttachment (10m0s) from k8s.io/client-go/informers/factory.go:135
I0618 00:12:33.132766       1 reflector.go:153] Starting reflector *v1beta1.CSINode (10m0s) from k8s.io/client-go/informers/factory.go:135
I0618 00:12:33.132780       1 reflector.go:153] Starting reflector *v1.PersistentVolume (10m0s) from k8s.io/client-go/informers/factory.go:135
I0618 00:12:33.132783       1 reflector.go:188] Listing and watching *v1beta1.CSINode from k8s.io/client-go/informers/factory.go:135
I0618 00:12:33.132791       1 reflector.go:188] Listing and watching *v1.PersistentVolume from k8s.io/client-go/informers/factory.go:135
I0618 00:12:33.132782       1 reflector.go:188] Listing and watching *v1beta1.VolumeAttachment from k8s.io/client-go/informers/factory.go:135
I0618 00:12:33.232671       1 shared_informer.go:227] caches populated
I0618 00:12:33.232727       1 csi_handler.go:116] Reconciling VolumeAttachments with driver backend state
I0618 00:12:33.232760       1 connection.go:182] GRPC call: /csi.v1.Controller/ListVolumes
I0618 00:12:33.232768       1 connection.go:183] GRPC request: {}
I0618 00:12:33.233973       1 connection.go:185] GRPC response: {"entries":[{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-4040"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 1"},"volume_id":"1"}},{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-4040"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 2"},"volume_id":"2"}},{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-4040"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 3"},"volume_id":"3"}}]}
I0618 00:12:33.237564       1 connection.go:186] GRPC error: <nil>
I0618 00:12:33.746195       1 controller.go:198] Started VA processing "csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab"
I0618 00:12:33.746210       1 controller.go:213] Skipping VolumeAttachment csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab for attacher csi-mock-csi-mock-volumes-4171
I0618 00:12:33.754526       1 controller.go:198] Started VA processing "csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab"
I0618 00:12:33.754541       1 controller.go:213] Skipping VolumeAttachment csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab for attacher csi-mock-csi-mock-volumes-4171
I0618 00:12:33.760840       1 controller.go:198] Started VA processing "csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab"
I0618 00:12:33.760853       1 controller.go:213] Skipping VolumeAttachment csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab for attacher csi-mock-csi-mock-volumes-4171
I0618 00:12:48.638738       1 controller.go:198] Started VA processing "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.638772       1 csi_handler.go:209] CSIHandler: processing VA "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.638784       1 csi_handler.go:236] Attaching "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.638799       1 csi_handler.go:396] Starting attach operation for "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.638878       1 csi_handler.go:335] Adding finalizer to PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e"
I0618 00:12:48.644545       1 csi_handler.go:344] PV finalizer added to "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e"
I0618 00:12:48.644591       1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-4040 in CSINode node2
I0618 00:12:48.644641       1 csi_handler.go:297] VA finalizer added to "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.644654       1 csi_handler.go:311] NodeID annotation added to "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.648285       1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerPublishVolume
I0618 00:12:48.648297       1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-4040","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e","storage.kubernetes.io/csiProvisionerIdentity":"1655511152775-8081-csi-mock-csi-mock-volumes-4040"},"volume_id":"4"}
I0618 00:12:48.650208       1 connection.go:185] GRPC response: {"publish_context":{"device":"/dev/mock","readonly":"false"}}
I0618 00:12:48.650666       1 connection.go:186] GRPC error: <nil>
I0618 00:12:48.650673       1 csi_handler.go:249] Attached "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.650686       1 util.go:35] Marking as attached "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.655610       1 util.go:48] Marked as attached "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.655625       1 csi_handler.go:255] Fully attached "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.655632       1 csi_handler.go:225] CSIHandler: finished processing "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.655653       1 controller.go:198] Started VA processing "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.655664       1 csi_handler.go:209] CSIHandler: processing VA "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:48.655674       1 csi_handler.go:231] "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e" is already attached
I0618 00:12:48.655683       1 csi_handler.go:225] CSIHandler: finished processing "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:12:49.139994       1 controller.go:198] Started VA processing "csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe"
I0618 00:12:49.140008       1 controller.go:213] Skipping VolumeAttachment csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe for attacher csi-mock-csi-mock-volumes-6733
I0618 00:12:49.147929       1 controller.go:198] Started VA processing "csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe"
I0618 00:12:49.147954       1 controller.go:213] Skipping VolumeAttachment csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe for attacher csi-mock-csi-mock-volumes-6733
I0618 00:12:49.154870       1 controller.go:198] Started VA processing "csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe"
I0618 00:12:49.154889       1 controller.go:213] Skipping VolumeAttachment csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe for attacher csi-mock-csi-mock-volumes-6733
I0618 00:12:56.402351       1 controller.go:198] Started VA processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d"
I0618 00:12:56.402368       1 controller.go:213] Skipping VolumeAttachment csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d for attacher csi-mock-csi-mock-volumes-5292
I0618 00:12:56.417105       1 controller.go:198] Started VA processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d"
I0618 00:12:56.417120       1 controller.go:213] Skipping VolumeAttachment csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d for attacher csi-mock-csi-mock-volumes-5292
I0618 00:12:56.460918       1 controller.go:198] Started VA processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d"
I0618 00:12:56.460945       1 controller.go:213] Skipping VolumeAttachment csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d for attacher csi-mock-csi-mock-volumes-5292
I0618 00:13:03.866571       1 controller.go:198] Started VA processing "csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab"
I0618 00:13:03.866589       1 controller.go:213] Skipping VolumeAttachment csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab for attacher csi-mock-csi-mock-volumes-4171
I0618 00:13:03.872808       1 controller.go:232] Started PV processing "pvc-2f6f4510-b794-4a10-8ca4-c3fe94803867"
I0618 00:13:03.872827       1 csi_handler.go:591] CSIHandler: processing PV "pvc-2f6f4510-b794-4a10-8ca4-c3fe94803867"
I0618 00:13:03.872835       1 csi_handler.go:595] CSIHandler: processing PV "pvc-2f6f4510-b794-4a10-8ca4-c3fe94803867": no deletion timestamp, ignoring
I0618 00:13:14.140159       1 controller.go:198] Started VA processing "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:13:14.140179       1 csi_handler.go:209] CSIHandler: processing VA "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:13:14.140192       1 csi_handler.go:260] Starting detach operation for "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:13:14.140211       1 csi_handler.go:267] Detaching "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:13:14.140222       1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-4040 in CSINode node2
I0618 00:13:14.140271       1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume
I0618 00:13:14.140277       1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-4040","volume_id":"4"}
I0618 00:13:14.141666       1 connection.go:185] GRPC response: {}
I0618 00:13:14.142041       1 connection.go:186] GRPC error: <nil>
I0618 00:13:14.142051       1 csi_handler.go:549] Detached "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:13:14.142075       1 util.go:76] Marking as detached "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:13:14.148064       1 controller.go:232] Started PV processing "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e"
I0618 00:13:14.148080       1 csi_handler.go:591] CSIHandler: processing PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e"
I0618 00:13:14.148082       1 util.go:90] Finalizer removed from "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:13:14.148091       1 csi_handler.go:595] CSIHandler: processing PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e": no deletion timestamp, ignoring
I0618 00:13:14.148096       1 csi_handler.go:280] Fully detached "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:13:14.148105       1 csi_handler.go:225] CSIHandler: finished processing "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e"
I0618 00:13:14.148845       1 controller.go:198] Started VA processing "csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe"
I0618 00:13:14.148858       1 controller.go:213] Skipping VolumeAttachment csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe for attacher csi-mock-csi-mock-volumes-6733
I0618 00:13:14.154773       1 controller.go:232] Started PV processing "pvc-38229df3-fe87-4b3d-a1ab-65de2ca36a09"
I0618 00:13:14.154786       1 csi_handler.go:591] CSIHandler: processing PV "pvc-38229df3-fe87-4b3d-a1ab-65de2ca36a09"
I0618 00:13:14.154793       1 csi_handler.go:595] CSIHandler: processing PV "pvc-38229df3-fe87-4b3d-a1ab-65de2ca36a09": no deletion timestamp, ignoring
I0618 00:13:16.615301       1 controller.go:232] Started PV processing "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e"
I0618 00:13:16.615318       1 csi_handler.go:591] CSIHandler: processing PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e"
I0618 00:13:16.615331       1 csi_handler.go:633] CSIHandler: processing PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e": no VA found, removing finalizer
E0618 00:13:16.619842       1 csi_handler.go:650] Failed to remove finalizer from PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e": PersistentVolume "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{"kubernetes.io/pv-protection"}
I0618 00:13:16.619880       1 controller.go:232] Started PV processing "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e"
I0618 00:13:16.619887       1 csi_handler.go:591] CSIHandler: processing PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e"
I0618 00:13:16.619909       1 csi_handler.go:633] CSIHandler: processing PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e": no VA found, removing finalizer
I0618 00:13:16.624587       1 csi_handler.go:655] Removed finalizer from PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e"
I0618 00:13:17.620011       1 controller.go:232] Started PV processing "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e"
I0618 00:13:17.620035       1 controller.go:239] PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e" deleted, ignoring
==== end of pod log for container csi-mockplugin-attacher-0/csi-attacher ====