==== start of pod log for container csi-mockplugin-attacher-0/csi-attacher ==== I0618 00:12:49.486251 1 main.go:91] Version: v2.2.0-0-g97411fa7 I0618 00:12:49.487979 1 connection.go:153] Connecting to unix:///csi/csi.sock I0618 00:12:52.707119 1 common.go:111] Probing CSI driver for readiness I0618 00:12:52.707191 1 connection.go:182] GRPC call: /csi.v1.Identity/Probe I0618 00:12:52.707213 1 connection.go:183] GRPC request: {} I0618 00:12:52.726183 1 connection.go:185] GRPC response: {"ready":{"value":true}} I0618 00:12:52.726596 1 connection.go:186] GRPC error: I0618 00:12:52.726614 1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginInfo I0618 00:12:52.726621 1 connection.go:183] GRPC request: {} I0618 00:12:52.732219 1 connection.go:185] GRPC response: {"manifest":{"url":"https://github.com/kubernetes-csi/csi-test/mock"},"name":"csi-mock-csi-mock-volumes-5292","vendor_version":"0.3.0"} I0618 00:12:52.732597 1 connection.go:186] GRPC error: I0618 00:12:52.732605 1 main.go:136] CSI driver name: "csi-mock-csi-mock-volumes-5292" W0618 00:12:52.732614 1 metrics.go:142] metrics endpoint will not be started because `metrics-address` was not specified. I0618 00:12:52.732619 1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0618 00:12:52.732623 1 connection.go:183] GRPC request: {} I0618 00:12:52.734840 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]} I0618 00:12:52.736672 1 connection.go:186] GRPC error: I0618 00:12:52.736681 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0618 00:12:52.736685 1 connection.go:183] GRPC request: {} I0618 00:12:52.737640 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]} I0618 00:12:52.742192 1 connection.go:186] GRPC error: I0618 00:12:52.742254 1 main.go:162] CSI driver supports ControllerPublishUnpublish, using real CSI handler I0618 00:12:52.742262 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0618 00:12:52.742266 1 connection.go:183] GRPC request: {} I0618 00:12:52.742990 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]} I0618 00:12:52.747281 1 connection.go:186] GRPC error: I0618 00:12:52.747298 1 main.go:175] CSI driver supports list volumes published nodes. Using capability to reconcile volume attachment objects with actual backend state I0618 00:12:52.747449 1 controller.go:121] Starting CSI attacher I0618 00:12:52.747686 1 reflector.go:153] Starting reflector *v1.PersistentVolume (10m0s) from k8s.io/client-go/informers/factory.go:135 I0618 00:12:52.747700 1 reflector.go:153] Starting reflector *v1beta1.VolumeAttachment (10m0s) from k8s.io/client-go/informers/factory.go:135 I0618 00:12:52.747703 1 reflector.go:188] Listing and watching *v1.PersistentVolume from k8s.io/client-go/informers/factory.go:135 I0618 00:12:52.747712 1 reflector.go:188] Listing and watching *v1beta1.VolumeAttachment from k8s.io/client-go/informers/factory.go:135 I0618 00:12:52.747723 1 reflector.go:153] Starting reflector *v1beta1.CSINode (10m0s) from k8s.io/client-go/informers/factory.go:135 I0618 00:12:52.747734 1 reflector.go:188] Listing and watching *v1beta1.CSINode from k8s.io/client-go/informers/factory.go:135 I0618 00:12:52.847732 1 shared_informer.go:227] caches populated I0618 00:12:52.847825 1 csi_handler.go:116] Reconciling VolumeAttachments with driver backend state I0618 00:12:52.847847 1 controller.go:198] Started VA processing "csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab" I0618 00:12:52.847850 1 controller.go:198] Started VA processing "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e" I0618 00:12:52.847862 1 controller.go:213] Skipping VolumeAttachment csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab for attacher csi-mock-csi-mock-volumes-4171 I0618 00:12:52.847860 1 controller.go:198] Started VA processing "csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe" I0618 00:12:52.847879 1 controller.go:213] Skipping VolumeAttachment csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe for attacher csi-mock-csi-mock-volumes-6733 I0618 00:12:52.847869 1 controller.go:213] Skipping VolumeAttachment csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e for attacher csi-mock-csi-mock-volumes-4040 I0618 00:12:52.847852 1 connection.go:182] GRPC call: /csi.v1.Controller/ListVolumes I0618 00:12:52.847910 1 connection.go:183] GRPC request: {} I0618 00:12:52.852339 1 connection.go:185] GRPC response: {"entries":[{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-5292"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 1"},"volume_id":"1"}},{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-5292"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 2"},"volume_id":"2"}},{"status":{"published_node_ids":["csi-mock-csi-mock-volumes-5292"]},"volume":{"capacity_bytes":107374182400,"volume_context":{"name":"Mock Volume 3"},"volume_id":"3"}}]} I0618 00:12:52.856161 1 connection.go:186] GRPC error: W0618 00:12:52.856186 1 csi_handler.go:159] Failed to repair volume handle for driver csi-mock-csi-mock-volumes-4171: could not find In-Tree driver name for CSI plugin csi-mock-csi-mock-volumes-4171 W0618 00:12:52.856196 1 csi_handler.go:159] Failed to repair volume handle for driver csi-mock-csi-mock-volumes-4040: could not find In-Tree driver name for CSI plugin csi-mock-csi-mock-volumes-4040 W0618 00:12:52.856201 1 csi_handler.go:159] Failed to repair volume handle for driver csi-mock-csi-mock-volumes-6733: could not find In-Tree driver name for CSI plugin csi-mock-csi-mock-volumes-6733 I0618 00:12:56.407127 1 controller.go:198] Started VA processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.407154 1 csi_handler.go:209] CSIHandler: processing VA "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.407166 1 csi_handler.go:236] Attaching "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.407181 1 csi_handler.go:396] Starting attach operation for "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.407273 1 csi_handler.go:335] Adding finalizer to PV "pvc-2407e147-b4f7-439e-886d-06136540a51c" I0618 00:12:56.415362 1 csi_handler.go:344] PV finalizer added to "pvc-2407e147-b4f7-439e-886d-06136540a51c" I0618 00:12:56.415384 1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-5292 in CSINode node1 I0618 00:12:56.415432 1 csi_handler.go:297] VA finalizer added to "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.415443 1 csi_handler.go:311] NodeID annotation added to "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.419177 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerPublishVolume I0618 00:12:56.419189 1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-5292","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2407e147-b4f7-439e-886d-06136540a51c","storage.kubernetes.io/csiProvisionerIdentity":"1655511172583-8081-csi-mock-csi-mock-volumes-5292"},"volume_id":"4"} I0618 00:12:56.458691 1 connection.go:185] GRPC response: {"publish_context":{"device":"/dev/mock","readonly":"false"}} I0618 00:12:56.459052 1 connection.go:186] GRPC error: I0618 00:12:56.459060 1 csi_handler.go:249] Attached "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.459067 1 util.go:35] Marking as attached "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.462727 1 util.go:48] Marked as attached "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.462742 1 csi_handler.go:255] Fully attached "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.462753 1 csi_handler.go:225] CSIHandler: finished processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.462780 1 controller.go:198] Started VA processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.462790 1 csi_handler.go:209] CSIHandler: processing VA "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.462798 1 csi_handler.go:231] "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" is already attached I0618 00:12:56.462813 1 csi_handler.go:225] CSIHandler: finished processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.462831 1 controller.go:198] Started VA processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.462840 1 csi_handler.go:209] CSIHandler: processing VA "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:12:56.462848 1 csi_handler.go:231] "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" is already attached I0618 00:12:56.462855 1 csi_handler.go:225] CSIHandler: finished processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:13:03.868919 1 controller.go:198] Started VA processing "csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab" I0618 00:13:03.868941 1 controller.go:213] Skipping VolumeAttachment csi-f6af658de6a4535cf2ffaa4483ffbd73aa88881bb61c6e4ea870f2e0319710ab for attacher csi-mock-csi-mock-volumes-4171 I0618 00:13:03.874954 1 controller.go:232] Started PV processing "pvc-2f6f4510-b794-4a10-8ca4-c3fe94803867" I0618 00:13:03.874971 1 csi_handler.go:591] CSIHandler: processing PV "pvc-2f6f4510-b794-4a10-8ca4-c3fe94803867" I0618 00:13:03.874979 1 csi_handler.go:595] CSIHandler: processing PV "pvc-2f6f4510-b794-4a10-8ca4-c3fe94803867": no deletion timestamp, ignoring I0618 00:13:14.142765 1 controller.go:198] Started VA processing "csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e" I0618 00:13:14.142792 1 controller.go:213] Skipping VolumeAttachment csi-35c2c9ec7d5aed383ea0a5ba5122bb4eec9a4511c579973541a45cc4b0c4b96e for attacher csi-mock-csi-mock-volumes-4040 I0618 00:13:14.150963 1 controller.go:232] Started PV processing "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e" I0618 00:13:14.150979 1 csi_handler.go:591] CSIHandler: processing PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e" I0618 00:13:14.150991 1 csi_handler.go:595] CSIHandler: processing PV "pvc-6be776ff-bcea-4de0-a66d-9456ef480c9e": no deletion timestamp, ignoring I0618 00:13:14.151032 1 controller.go:198] Started VA processing "csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe" I0618 00:13:14.151043 1 controller.go:213] Skipping VolumeAttachment csi-d1cb48f0a673ae4b30d69335218d194fb380ad25a49c4281483d6087004537fe for attacher csi-mock-csi-mock-volumes-6733 I0618 00:13:14.156750 1 controller.go:232] Started PV processing "pvc-38229df3-fe87-4b3d-a1ab-65de2ca36a09" I0618 00:13:14.156760 1 csi_handler.go:591] CSIHandler: processing PV "pvc-38229df3-fe87-4b3d-a1ab-65de2ca36a09" I0618 00:13:14.156767 1 csi_handler.go:595] CSIHandler: processing PV "pvc-38229df3-fe87-4b3d-a1ab-65de2ca36a09": no deletion timestamp, ignoring I0618 00:13:26.928458 1 controller.go:198] Started VA processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:13:26.928476 1 csi_handler.go:209] CSIHandler: processing VA "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:13:26.928482 1 csi_handler.go:260] Starting detach operation for "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:13:26.928505 1 csi_handler.go:267] Detaching "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:13:26.928519 1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-5292 in CSINode node1 I0618 00:13:26.928557 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume I0618 00:13:26.928563 1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-5292","volume_id":"4"} I0618 00:13:26.929502 1 connection.go:185] GRPC response: {} I0618 00:13:26.930035 1 connection.go:186] GRPC error: I0618 00:13:26.930047 1 csi_handler.go:549] Detached "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:13:26.930078 1 util.go:76] Marking as detached "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:13:26.938385 1 util.go:90] Finalizer removed from "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:13:26.938403 1 csi_handler.go:280] Fully detached "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:13:26.938410 1 csi_handler.go:225] CSIHandler: finished processing "csi-ec78d8c67d63bb8dc9a5cddc8a1cbf890273d62bbaa6ef56df1aff8b52e7dc3d" I0618 00:13:26.938521 1 controller.go:232] Started PV processing "pvc-2407e147-b4f7-439e-886d-06136540a51c" I0618 00:13:26.938533 1 csi_handler.go:591] CSIHandler: processing PV "pvc-2407e147-b4f7-439e-886d-06136540a51c" I0618 00:13:26.938541 1 csi_handler.go:595] CSIHandler: processing PV "pvc-2407e147-b4f7-439e-886d-06136540a51c": no deletion timestamp, ignoring I0618 00:13:30.418568 1 controller.go:232] Started PV processing "pvc-2407e147-b4f7-439e-886d-06136540a51c" I0618 00:13:30.418613 1 csi_handler.go:591] CSIHandler: processing PV "pvc-2407e147-b4f7-439e-886d-06136540a51c" I0618 00:13:30.418651 1 csi_handler.go:633] CSIHandler: processing PV "pvc-2407e147-b4f7-439e-886d-06136540a51c": no VA found, removing finalizer E0618 00:13:30.425908 1 csi_handler.go:650] Failed to remove finalizer from PV "pvc-2407e147-b4f7-439e-886d-06136540a51c": PersistentVolume "pvc-2407e147-b4f7-439e-886d-06136540a51c" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{"kubernetes.io/pv-protection"} I0618 00:13:30.425948 1 controller.go:232] Started PV processing "pvc-2407e147-b4f7-439e-886d-06136540a51c" I0618 00:13:30.425960 1 csi_handler.go:591] CSIHandler: processing PV "pvc-2407e147-b4f7-439e-886d-06136540a51c" I0618 00:13:30.425978 1 csi_handler.go:633] CSIHandler: processing PV "pvc-2407e147-b4f7-439e-886d-06136540a51c": no VA found, removing finalizer I0618 00:13:30.430963 1 csi_handler.go:655] Removed finalizer from PV "pvc-2407e147-b4f7-439e-886d-06136540a51c" I0618 00:13:31.426068 1 controller.go:232] Started PV processing "pvc-2407e147-b4f7-439e-886d-06136540a51c" I0618 00:13:31.426097 1 controller.go:239] PV "pvc-2407e147-b4f7-439e-886d-06136540a51c" deleted, ignoring I0618 00:13:32.860740 1 controller.go:198] Started VA processing "csi-f2765f5bc348e971f1ca9c18cad3ef61de0bce20c92f5c4050520abf57a4a63b" I0618 00:13:32.860760 1 controller.go:213] Skipping VolumeAttachment csi-f2765f5bc348e971f1ca9c18cad3ef61de0bce20c92f5c4050520abf57a4a63b for attacher csi-mock-csi-mock-volumes-3945 I0618 00:13:32.875170 1 controller.go:198] Started VA processing "csi-f2765f5bc348e971f1ca9c18cad3ef61de0bce20c92f5c4050520abf57a4a63b" I0618 00:13:32.875184 1 controller.go:213] Skipping VolumeAttachment csi-f2765f5bc348e971f1ca9c18cad3ef61de0bce20c92f5c4050520abf57a4a63b for attacher csi-mock-csi-mock-volumes-3945 I0618 00:13:32.881741 1 controller.go:198] Started VA processing "csi-f2765f5bc348e971f1ca9c18cad3ef61de0bce20c92f5c4050520abf57a4a63b" I0618 00:13:32.881754 1 controller.go:213] Skipping VolumeAttachment csi-f2765f5bc348e971f1ca9c18cad3ef61de0bce20c92f5c4050520abf57a4a63b for attacher csi-mock-csi-mock-volumes-3945 ==== end of pod log for container csi-mockplugin-attacher-0/csi-attacher ====