==== start of pod log for container csi-mockplugin-attacher-0/csi-attacher ==== I0522 01:21:17.324626 1 main.go:91] Version: v2.2.0-0-g97411fa7 I0522 01:21:17.326173 1 connection.go:153] Connecting to unix:///csi/csi.sock I0522 01:21:22.293412 1 common.go:111] Probing CSI driver for readiness I0522 01:21:22.293448 1 connection.go:182] GRPC call: /csi.v1.Identity/Probe I0522 01:21:22.293456 1 connection.go:183] GRPC request: {} I0522 01:21:22.295023 1 connection.go:185] GRPC response: {"ready":{"value":true}} I0522 01:21:22.295541 1 connection.go:186] GRPC error: I0522 01:21:22.295556 1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginInfo I0522 01:21:22.295560 1 connection.go:183] GRPC request: {} I0522 01:21:22.296679 1 connection.go:185] GRPC response: {"manifest":{"url":"https://github.com/kubernetes-csi/csi-test/mock"},"name":"csi-mock-csi-mock-volumes-3021","vendor_version":"0.3.0"} I0522 01:21:22.297093 1 connection.go:186] GRPC error: I0522 01:21:22.297104 1 main.go:136] CSI driver name: "csi-mock-csi-mock-volumes-3021" W0522 01:21:22.297115 1 metrics.go:142] metrics endpoint will not be started because `metrics-address` was not specified. I0522 01:21:22.297125 1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0522 01:21:22.297130 1 connection.go:183] GRPC request: {} I0522 01:21:22.297692 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]} I0522 01:21:22.300214 1 connection.go:186] GRPC error: I0522 01:21:22.300223 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0522 01:21:22.300230 1 connection.go:183] GRPC request: {} I0522 01:21:22.300774 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]} I0522 01:21:22.304622 1 connection.go:186] GRPC error: I0522 01:21:22.304680 1 main.go:162] CSI driver supports ControllerPublishUnpublish, using real CSI handler I0522 01:21:22.304686 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0522 01:21:22.304690 1 connection.go:183] GRPC request: {} I0522 01:21:22.305183 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]} I0522 01:21:22.308337 1 connection.go:186] GRPC error: I0522 01:21:22.308664 1 controller.go:121] Starting CSI attacher I0522 01:21:22.309227 1 reflector.go:153] Starting reflector *v1.PersistentVolume (10m0s) from k8s.io/client-go/informers/factory.go:135 I0522 01:21:22.309249 1 reflector.go:188] Listing and watching *v1.PersistentVolume from k8s.io/client-go/informers/factory.go:135 I0522 01:21:22.309246 1 reflector.go:153] Starting reflector *v1beta1.VolumeAttachment (10m0s) from k8s.io/client-go/informers/factory.go:135 I0522 01:21:22.309260 1 reflector.go:188] Listing and watching *v1beta1.VolumeAttachment from k8s.io/client-go/informers/factory.go:135 I0522 01:21:22.309424 1 reflector.go:153] Starting reflector *v1beta1.CSINode (10m0s) from k8s.io/client-go/informers/factory.go:135 I0522 01:21:22.309444 1 reflector.go:188] Listing and watching *v1beta1.CSINode from k8s.io/client-go/informers/factory.go:135 I0522 01:21:22.408798 1 shared_informer.go:227] caches populated I0522 01:21:26.765311 1 controller.go:198] Started VA processing "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.765340 1 csi_handler.go:209] CSIHandler: processing VA "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.765352 1 csi_handler.go:236] Attaching "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.765369 1 csi_handler.go:396] Starting attach operation for "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.765451 1 csi_handler.go:335] Adding finalizer to PV "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" I0522 01:21:26.782785 1 csi_handler.go:344] PV finalizer added to "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" I0522 01:21:26.782834 1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-3021 in CSINode node1 I0522 01:21:26.782880 1 csi_handler.go:297] VA finalizer added to "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.782890 1 csi_handler.go:311] NodeID annotation added to "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.786015 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerPublishVolume I0522 01:21:26.786032 1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-3021","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50","storage.kubernetes.io/csiProvisionerIdentity":"1621646482215-8081-csi-mock-csi-mock-volumes-3021"},"volume_id":"4"} I0522 01:21:26.787996 1 connection.go:185] GRPC response: {"publish_context":{"device":"/dev/mock","readonly":"false"}} I0522 01:21:26.788958 1 connection.go:186] GRPC error: I0522 01:21:26.788969 1 csi_handler.go:249] Attached "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.788986 1 util.go:35] Marking as attached "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.793838 1 util.go:48] Marked as attached "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.793853 1 csi_handler.go:255] Fully attached "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.793860 1 csi_handler.go:225] CSIHandler: finished processing "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.793882 1 controller.go:198] Started VA processing "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.793890 1 csi_handler.go:209] CSIHandler: processing VA "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:26.793900 1 csi_handler.go:231] "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" is already attached I0522 01:21:26.793908 1 csi_handler.go:225] CSIHandler: finished processing "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:21:43.998411 1 controller.go:198] Started VA processing "csi-408546edeefb6e335a1d23d2fdecdda70d5caf2d0c84eccbe32e9dd24cc3f668" I0522 01:21:43.998430 1 controller.go:213] Skipping VolumeAttachment csi-408546edeefb6e335a1d23d2fdecdda70d5caf2d0c84eccbe32e9dd24cc3f668 for attacher csi-mock-csi-mock-volumes-7364 I0522 01:21:44.012932 1 controller.go:198] Started VA processing "csi-408546edeefb6e335a1d23d2fdecdda70d5caf2d0c84eccbe32e9dd24cc3f668" I0522 01:21:44.012946 1 controller.go:213] Skipping VolumeAttachment csi-408546edeefb6e335a1d23d2fdecdda70d5caf2d0c84eccbe32e9dd24cc3f668 for attacher csi-mock-csi-mock-volumes-7364 I0522 01:21:44.018380 1 controller.go:198] Started VA processing "csi-408546edeefb6e335a1d23d2fdecdda70d5caf2d0c84eccbe32e9dd24cc3f668" I0522 01:21:44.018402 1 controller.go:213] Skipping VolumeAttachment csi-408546edeefb6e335a1d23d2fdecdda70d5caf2d0c84eccbe32e9dd24cc3f668 for attacher csi-mock-csi-mock-volumes-7364 I0522 01:21:56.937552 1 controller.go:198] Started VA processing "csi-408546edeefb6e335a1d23d2fdecdda70d5caf2d0c84eccbe32e9dd24cc3f668" I0522 01:21:56.937576 1 controller.go:213] Skipping VolumeAttachment csi-408546edeefb6e335a1d23d2fdecdda70d5caf2d0c84eccbe32e9dd24cc3f668 for attacher csi-mock-csi-mock-volumes-7364 I0522 01:21:56.945206 1 controller.go:232] Started PV processing "pvc-8f64e6b8-3d0a-4178-8746-199d484484d6" I0522 01:21:56.945224 1 csi_handler.go:591] CSIHandler: processing PV "pvc-8f64e6b8-3d0a-4178-8746-199d484484d6" I0522 01:21:56.945231 1 csi_handler.go:595] CSIHandler: processing PV "pvc-8f64e6b8-3d0a-4178-8746-199d484484d6": no deletion timestamp, ignoring I0522 01:22:34.200715 1 controller.go:198] Started VA processing "csi-44ac3d8cb5ed52a7705c4ba66cbacced0f37e82976c713da421e7564cd57853a" I0522 01:22:34.200731 1 controller.go:213] Skipping VolumeAttachment csi-44ac3d8cb5ed52a7705c4ba66cbacced0f37e82976c713da421e7564cd57853a for attacher csi-mock-csi-mock-volumes-6723 I0522 01:22:34.209106 1 controller.go:198] Started VA processing "csi-44ac3d8cb5ed52a7705c4ba66cbacced0f37e82976c713da421e7564cd57853a" I0522 01:22:34.209117 1 controller.go:213] Skipping VolumeAttachment csi-44ac3d8cb5ed52a7705c4ba66cbacced0f37e82976c713da421e7564cd57853a for attacher csi-mock-csi-mock-volumes-6723 I0522 01:22:34.214701 1 controller.go:198] Started VA processing "csi-44ac3d8cb5ed52a7705c4ba66cbacced0f37e82976c713da421e7564cd57853a" I0522 01:22:34.214713 1 controller.go:213] Skipping VolumeAttachment csi-44ac3d8cb5ed52a7705c4ba66cbacced0f37e82976c713da421e7564cd57853a for attacher csi-mock-csi-mock-volumes-6723 I0522 01:23:03.967398 1 controller.go:198] Started VA processing "csi-44ac3d8cb5ed52a7705c4ba66cbacced0f37e82976c713da421e7564cd57853a" I0522 01:23:03.967839 1 controller.go:213] Skipping VolumeAttachment csi-44ac3d8cb5ed52a7705c4ba66cbacced0f37e82976c713da421e7564cd57853a for attacher csi-mock-csi-mock-volumes-6723 I0522 01:23:03.974775 1 controller.go:232] Started PV processing "pvc-d25f21ab-ae7f-4858-923d-0840c4e7d835" I0522 01:23:03.974789 1 csi_handler.go:591] CSIHandler: processing PV "pvc-d25f21ab-ae7f-4858-923d-0840c4e7d835" I0522 01:23:03.974816 1 csi_handler.go:611] CSIHandler: processing PV "pvc-d25f21ab-ae7f-4858-923d-0840c4e7d835": no finalizer, ignoring I0522 01:23:20.605036 1 controller.go:198] Started VA processing "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:23:20.605054 1 csi_handler.go:209] CSIHandler: processing VA "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:23:20.605060 1 csi_handler.go:260] Starting detach operation for "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:23:20.605084 1 csi_handler.go:267] Detaching "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:23:20.605096 1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-3021 in CSINode node1 I0522 01:23:20.605132 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume I0522 01:23:20.605137 1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-3021","volume_id":"4"} I0522 01:23:20.606101 1 connection.go:185] GRPC response: {} I0522 01:23:20.606582 1 connection.go:186] GRPC error: I0522 01:23:20.606593 1 csi_handler.go:549] Detached "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:23:20.606621 1 util.go:76] Marking as detached "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:23:20.612301 1 controller.go:232] Started PV processing "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" I0522 01:23:20.612321 1 csi_handler.go:591] CSIHandler: processing PV "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" I0522 01:23:20.612329 1 csi_handler.go:595] CSIHandler: processing PV "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50": no deletion timestamp, ignoring I0522 01:23:20.612552 1 util.go:90] Finalizer removed from "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:23:20.612572 1 csi_handler.go:280] Fully detached "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:23:20.612583 1 csi_handler.go:225] CSIHandler: finished processing "csi-f282b68928235c1e824bf3e25e1d02897c4ec108631561b5e523e6cb2d07db16" I0522 01:23:20.730091 1 controller.go:232] Started PV processing "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" I0522 01:23:20.730108 1 csi_handler.go:591] CSIHandler: processing PV "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" I0522 01:23:20.730130 1 csi_handler.go:633] CSIHandler: processing PV "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50": no VA found, removing finalizer E0522 01:23:20.734538 1 csi_handler.go:650] Failed to remove finalizer from PV "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50": PersistentVolume "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{"kubernetes.io/pv-protection"} I0522 01:23:20.734570 1 controller.go:232] Started PV processing "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" I0522 01:23:20.734581 1 csi_handler.go:591] CSIHandler: processing PV "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" I0522 01:23:20.734601 1 csi_handler.go:633] CSIHandler: processing PV "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50": no VA found, removing finalizer I0522 01:23:20.739738 1 csi_handler.go:655] Removed finalizer from PV "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" I0522 01:23:21.734803 1 controller.go:232] Started PV processing "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" I0522 01:23:21.734859 1 controller.go:239] PV "pvc-7455e90f-c12e-49eb-9ebb-fc82f0bc1a50" deleted, ignoring ==== end of pod log for container csi-mockplugin-attacher-0/csi-attacher ====