==== start of pod log for container csi-mockplugin-attacher-0/csi-attacher ==== I0828 02:56:12.109404 1 main.go:91] Version: v2.2.0-0-g97411fa7 I0828 02:56:12.110891 1 connection.go:153] Connecting to unix:///csi/csi.sock I0828 02:56:15.599739 1 common.go:111] Probing CSI driver for readiness I0828 02:56:15.599784 1 connection.go:182] GRPC call: /csi.v1.Identity/Probe I0828 02:56:15.599797 1 connection.go:183] GRPC request: {} I0828 02:56:15.601641 1 connection.go:185] GRPC response: {"ready":{"value":true}} I0828 02:56:15.602057 1 connection.go:186] GRPC error: I0828 02:56:15.602082 1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginInfo I0828 02:56:15.602089 1 connection.go:183] GRPC request: {} I0828 02:56:15.602735 1 connection.go:185] GRPC response: {"manifest":{"url":"https://github.com/kubernetes-csi/csi-test/mock"},"name":"csi-mock-csi-mock-volumes-4084","vendor_version":"0.3.0"} I0828 02:56:15.603080 1 connection.go:186] GRPC error: I0828 02:56:15.603089 1 main.go:136] CSI driver name: "csi-mock-csi-mock-volumes-4084" W0828 02:56:15.603098 1 metrics.go:142] metrics endpoint will not be started because `metrics-address` was not specified. I0828 02:56:15.603106 1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0828 02:56:15.603110 1 connection.go:183] GRPC request: {} I0828 02:56:15.603838 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]} I0828 02:56:15.605867 1 connection.go:186] GRPC error: I0828 02:56:15.605876 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0828 02:56:15.605880 1 connection.go:183] GRPC request: {} I0828 02:56:15.606750 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]} I0828 02:56:15.609297 1 connection.go:186] GRPC error: I0828 02:56:15.609349 1 main.go:162] CSI driver supports ControllerPublishUnpublish, using real CSI handler I0828 02:56:15.609357 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0828 02:56:15.609361 1 connection.go:183] GRPC request: {} I0828 02:56:15.609915 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]} I0828 02:56:15.613203 1 connection.go:186] GRPC error: I0828 02:56:15.613347 1 controller.go:121] Starting CSI attacher I0828 02:56:15.614060 1 reflector.go:153] Starting reflector *v1.PersistentVolume (10m0s) from k8s.io/client-go/informers/factory.go:135 I0828 02:56:15.614098 1 reflector.go:153] Starting reflector *v1beta1.CSINode (10m0s) from k8s.io/client-go/informers/factory.go:135 I0828 02:56:15.614119 1 reflector.go:188] Listing and watching *v1beta1.CSINode from k8s.io/client-go/informers/factory.go:135 I0828 02:56:15.614107 1 reflector.go:188] Listing and watching *v1.PersistentVolume from k8s.io/client-go/informers/factory.go:135 I0828 02:56:15.614711 1 reflector.go:153] Starting reflector *v1beta1.VolumeAttachment (10m0s) from k8s.io/client-go/informers/factory.go:135 I0828 02:56:15.614868 1 reflector.go:188] Listing and watching *v1beta1.VolumeAttachment from k8s.io/client-go/informers/factory.go:135 I0828 02:56:15.713662 1 shared_informer.go:227] caches populated I0828 02:56:22.984442 1 controller.go:198] Started VA processing "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.984465 1 csi_handler.go:209] CSIHandler: processing VA "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.984474 1 csi_handler.go:236] Attaching "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.984487 1 csi_handler.go:396] Starting attach operation for "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.984536 1 csi_handler.go:335] Adding finalizer to PV "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" I0828 02:56:22.988784 1 csi_handler.go:344] PV finalizer added to "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" I0828 02:56:22.988827 1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-4084 in CSINode node1 I0828 02:56:22.988863 1 csi_handler.go:297] VA finalizer added to "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.988872 1 csi_handler.go:311] NodeID annotation added to "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.991706 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerPublishVolume I0828 02:56:22.991718 1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-4084","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-e959cc94-c357-43b7-a850-9a0a25d8582d","storage.kubernetes.io/csiProvisionerIdentity":"1630119376236-8081-csi-mock-csi-mock-volumes-4084"},"volume_id":"4"} I0828 02:56:22.993384 1 connection.go:185] GRPC response: {"publish_context":{"device":"/dev/mock","readonly":"false"}} I0828 02:56:22.993748 1 connection.go:186] GRPC error: I0828 02:56:22.993755 1 csi_handler.go:249] Attached "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.993762 1 util.go:35] Marking as attached "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.996769 1 util.go:48] Marked as attached "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.996782 1 csi_handler.go:255] Fully attached "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.996790 1 csi_handler.go:225] CSIHandler: finished processing "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.996816 1 controller.go:198] Started VA processing "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.996830 1 csi_handler.go:209] CSIHandler: processing VA "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:22.996842 1 csi_handler.go:231] "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" is already attached I0828 02:56:22.996850 1 csi_handler.go:225] CSIHandler: finished processing "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:56:35.310042 1 controller.go:198] Started VA processing "csi-68baadcbac060909da5124950b06ac1ae0e3a20ea20fa4f632eccd0de36add5f" I0828 02:56:35.310063 1 controller.go:213] Skipping VolumeAttachment csi-68baadcbac060909da5124950b06ac1ae0e3a20ea20fa4f632eccd0de36add5f for attacher csi-mock-csi-mock-volumes-2731 I0828 02:56:35.325665 1 controller.go:198] Started VA processing "csi-68baadcbac060909da5124950b06ac1ae0e3a20ea20fa4f632eccd0de36add5f" I0828 02:56:35.325678 1 controller.go:213] Skipping VolumeAttachment csi-68baadcbac060909da5124950b06ac1ae0e3a20ea20fa4f632eccd0de36add5f for attacher csi-mock-csi-mock-volumes-2731 I0828 02:56:35.331593 1 controller.go:198] Started VA processing "csi-68baadcbac060909da5124950b06ac1ae0e3a20ea20fa4f632eccd0de36add5f" I0828 02:56:35.331607 1 controller.go:213] Skipping VolumeAttachment csi-68baadcbac060909da5124950b06ac1ae0e3a20ea20fa4f632eccd0de36add5f for attacher csi-mock-csi-mock-volumes-2731 I0828 02:56:41.027593 1 controller.go:198] Started VA processing "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.027643 1 csi_handler.go:209] CSIHandler: processing VA "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.027670 1 csi_handler.go:236] Attaching "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.027698 1 csi_handler.go:396] Starting attach operation for "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.027828 1 csi_handler.go:335] Adding finalizer to PV "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" I0828 02:56:41.031656 1 csi_handler.go:344] PV finalizer added to "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" I0828 02:56:41.031676 1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-4084 in CSINode node1 I0828 02:56:41.031690 1 csi_handler.go:297] VA finalizer added to "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.031697 1 csi_handler.go:311] NodeID annotation added to "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.034349 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerPublishVolume I0828 02:56:41.034364 1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-4084","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-21573098-1e38-4fe5-8a38-3836e1746ce2","storage.kubernetes.io/csiProvisionerIdentity":"1630119376236-8081-csi-mock-csi-mock-volumes-4084"},"volume_id":"5"} I0828 02:56:41.035777 1 connection.go:185] GRPC response: {"publish_context":{"device":"/dev/mock","readonly":"false"}} I0828 02:56:41.037224 1 connection.go:186] GRPC error: I0828 02:56:41.037235 1 csi_handler.go:249] Attached "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.037246 1 util.go:35] Marking as attached "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.040539 1 util.go:48] Marked as attached "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.040554 1 csi_handler.go:255] Fully attached "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.040560 1 csi_handler.go:225] CSIHandler: finished processing "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.040581 1 controller.go:198] Started VA processing "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.040588 1 csi_handler.go:209] CSIHandler: processing VA "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:41.040594 1 csi_handler.go:231] "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" is already attached I0828 02:56:41.040600 1 csi_handler.go:225] CSIHandler: finished processing "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:56:57.675525 1 controller.go:198] Started VA processing "csi-68baadcbac060909da5124950b06ac1ae0e3a20ea20fa4f632eccd0de36add5f" I0828 02:56:57.675574 1 controller.go:213] Skipping VolumeAttachment csi-68baadcbac060909da5124950b06ac1ae0e3a20ea20fa4f632eccd0de36add5f for attacher csi-mock-csi-mock-volumes-2731 I0828 02:56:57.684394 1 controller.go:232] Started PV processing "pvc-c65ea279-9911-4d05-924b-0241ca59f542" I0828 02:56:57.684459 1 csi_handler.go:591] CSIHandler: processing PV "pvc-c65ea279-9911-4d05-924b-0241ca59f542" I0828 02:56:57.684522 1 csi_handler.go:611] CSIHandler: processing PV "pvc-c65ea279-9911-4d05-924b-0241ca59f542": no finalizer, ignoring I0828 02:57:00.476837 1 controller.go:198] Started VA processing "csi-1063aec80d0d6b7ca3e8a6d525fd185aeb1b55e1ea62d751474e5c81328cd983" I0828 02:57:00.476872 1 controller.go:213] Skipping VolumeAttachment csi-1063aec80d0d6b7ca3e8a6d525fd185aeb1b55e1ea62d751474e5c81328cd983 for attacher csi-mock-csi-mock-volumes-2967 I0828 02:57:00.484008 1 controller.go:198] Started VA processing "csi-1063aec80d0d6b7ca3e8a6d525fd185aeb1b55e1ea62d751474e5c81328cd983" I0828 02:57:00.484018 1 controller.go:213] Skipping VolumeAttachment csi-1063aec80d0d6b7ca3e8a6d525fd185aeb1b55e1ea62d751474e5c81328cd983 for attacher csi-mock-csi-mock-volumes-2967 I0828 02:57:00.489365 1 controller.go:198] Started VA processing "csi-1063aec80d0d6b7ca3e8a6d525fd185aeb1b55e1ea62d751474e5c81328cd983" I0828 02:57:00.489376 1 controller.go:213] Skipping VolumeAttachment csi-1063aec80d0d6b7ca3e8a6d525fd185aeb1b55e1ea62d751474e5c81328cd983 for attacher csi-mock-csi-mock-volumes-2967 I0828 02:57:17.724494 1 controller.go:198] Started VA processing "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:57:17.724517 1 csi_handler.go:209] CSIHandler: processing VA "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:57:17.724523 1 csi_handler.go:260] Starting detach operation for "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:57:17.724546 1 csi_handler.go:267] Detaching "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:57:17.724558 1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-4084 in CSINode node1 I0828 02:57:17.724610 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume I0828 02:57:17.724618 1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-4084","volume_id":"4"} I0828 02:57:17.725669 1 connection.go:185] GRPC response: {} I0828 02:57:17.726086 1 connection.go:186] GRPC error: I0828 02:57:17.726097 1 csi_handler.go:549] Detached "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:57:17.726115 1 util.go:76] Marking as detached "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:57:17.732047 1 controller.go:232] Started PV processing "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" I0828 02:57:17.732063 1 csi_handler.go:591] CSIHandler: processing PV "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" I0828 02:57:17.732089 1 csi_handler.go:595] CSIHandler: processing PV "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d": no deletion timestamp, ignoring I0828 02:57:17.732166 1 util.go:90] Finalizer removed from "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:57:17.732178 1 csi_handler.go:280] Fully detached "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:57:17.732188 1 csi_handler.go:225] CSIHandler: finished processing "csi-75908e4475e52ba24e733216776227d282c4186374a6e66467cb11317ae7d58c" I0828 02:57:22.740616 1 controller.go:198] Started VA processing "csi-1063aec80d0d6b7ca3e8a6d525fd185aeb1b55e1ea62d751474e5c81328cd983" I0828 02:57:22.740632 1 controller.go:213] Skipping VolumeAttachment csi-1063aec80d0d6b7ca3e8a6d525fd185aeb1b55e1ea62d751474e5c81328cd983 for attacher csi-mock-csi-mock-volumes-2967 I0828 02:57:22.747429 1 controller.go:232] Started PV processing "pvc-94e996ba-9b4d-4d32-9664-6beeaa314834" I0828 02:57:22.747447 1 csi_handler.go:591] CSIHandler: processing PV "pvc-94e996ba-9b4d-4d32-9664-6beeaa314834" I0828 02:57:22.747480 1 csi_handler.go:611] CSIHandler: processing PV "pvc-94e996ba-9b4d-4d32-9664-6beeaa314834": no finalizer, ignoring I0828 02:57:30.552694 1 controller.go:198] Started VA processing "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.552710 1 csi_handler.go:209] CSIHandler: processing VA "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.552716 1 csi_handler.go:236] Attaching "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.552722 1 csi_handler.go:396] Starting attach operation for "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.552764 1 csi_handler.go:335] Adding finalizer to PV "pvc-29b56385-9192-453e-abfe-074938d79316" I0828 02:57:30.559501 1 csi_handler.go:344] PV finalizer added to "pvc-29b56385-9192-453e-abfe-074938d79316" I0828 02:57:30.559521 1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-4084 in CSINode node1 I0828 02:57:30.559540 1 csi_handler.go:297] VA finalizer added to "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.559551 1 csi_handler.go:311] NodeID annotation added to "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.562168 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerPublishVolume I0828 02:57:30.562176 1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-4084","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-29b56385-9192-453e-abfe-074938d79316","storage.kubernetes.io/csiProvisionerIdentity":"1630119376236-8081-csi-mock-csi-mock-volumes-4084"},"volume_id":"6"} I0828 02:57:30.563384 1 connection.go:185] GRPC response: {"publish_context":{"device":"/dev/mock","readonly":"false"}} I0828 02:57:30.563716 1 connection.go:186] GRPC error: I0828 02:57:30.563722 1 csi_handler.go:249] Attached "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.563729 1 util.go:35] Marking as attached "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.567148 1 util.go:48] Marked as attached "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.567159 1 csi_handler.go:255] Fully attached "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.567166 1 csi_handler.go:225] CSIHandler: finished processing "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.567186 1 controller.go:198] Started VA processing "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.567196 1 csi_handler.go:209] CSIHandler: processing VA "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:30.567205 1 csi_handler.go:231] "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" is already attached I0828 02:57:30.567210 1 csi_handler.go:225] CSIHandler: finished processing "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:33.076528 1 controller.go:198] Started VA processing "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:33.076560 1 csi_handler.go:209] CSIHandler: processing VA "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:33.076575 1 csi_handler.go:260] Starting detach operation for "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:33.076618 1 csi_handler.go:267] Detaching "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:33.076642 1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-4084 in CSINode node1 I0828 02:57:33.076663 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume I0828 02:57:33.076674 1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-4084","volume_id":"6"} I0828 02:57:33.078410 1 connection.go:185] GRPC response: {} I0828 02:57:33.078714 1 connection.go:186] GRPC error: I0828 02:57:33.078721 1 csi_handler.go:549] Detached "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:33.078740 1 util.go:76] Marking as detached "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:33.084439 1 util.go:90] Finalizer removed from "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:33.084450 1 controller.go:232] Started PV processing "pvc-29b56385-9192-453e-abfe-074938d79316" I0828 02:57:33.084471 1 csi_handler.go:280] Fully detached "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:33.084489 1 csi_handler.go:591] CSIHandler: processing PV "pvc-29b56385-9192-453e-abfe-074938d79316" I0828 02:57:33.084496 1 csi_handler.go:225] CSIHandler: finished processing "csi-8597d2f7f689fba7b127a2f9eb706dd77bed992744498e56bfd8c752108a21c5" I0828 02:57:33.084512 1 csi_handler.go:595] CSIHandler: processing PV "pvc-29b56385-9192-453e-abfe-074938d79316": no deletion timestamp, ignoring I0828 02:57:37.039800 1 controller.go:232] Started PV processing "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" I0828 02:57:37.039823 1 csi_handler.go:591] CSIHandler: processing PV "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" I0828 02:57:37.039838 1 csi_handler.go:633] CSIHandler: processing PV "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d": no VA found, removing finalizer E0828 02:57:37.044191 1 csi_handler.go:650] Failed to remove finalizer from PV "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d": PersistentVolume "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{"kubernetes.io/pv-protection"} I0828 02:57:37.044219 1 controller.go:232] Started PV processing "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" I0828 02:57:37.044227 1 csi_handler.go:591] CSIHandler: processing PV "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" I0828 02:57:37.044252 1 csi_handler.go:633] CSIHandler: processing PV "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d": no VA found, removing finalizer I0828 02:57:37.050815 1 csi_handler.go:655] Removed finalizer from PV "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" I0828 02:57:37.891608 1 controller.go:198] Started VA processing "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:57:37.891627 1 csi_handler.go:209] CSIHandler: processing VA "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:57:37.891632 1 csi_handler.go:260] Starting detach operation for "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:57:37.891664 1 csi_handler.go:267] Detaching "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:57:37.891675 1 csi_handler.go:689] Found NodeID csi-mock-csi-mock-volumes-4084 in CSINode node1 I0828 02:57:37.891713 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerUnpublishVolume I0828 02:57:37.891718 1 connection.go:183] GRPC request: {"node_id":"csi-mock-csi-mock-volumes-4084","volume_id":"5"} I0828 02:57:37.892430 1 connection.go:185] GRPC response: {} I0828 02:57:37.892744 1 connection.go:186] GRPC error: I0828 02:57:37.892750 1 csi_handler.go:549] Detached "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:57:37.892765 1 util.go:76] Marking as detached "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:57:37.898988 1 util.go:90] Finalizer removed from "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:57:37.899029 1 csi_handler.go:280] Fully detached "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:57:37.899048 1 csi_handler.go:225] CSIHandler: finished processing "csi-54d34529f1eb0da748f8fbcf25a1c829c6175de260c5e2ddf25ab560e89ce472" I0828 02:57:37.899118 1 controller.go:232] Started PV processing "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" I0828 02:57:37.899151 1 csi_handler.go:591] CSIHandler: processing PV "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" I0828 02:57:37.899187 1 csi_handler.go:595] CSIHandler: processing PV "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2": no deletion timestamp, ignoring I0828 02:57:38.044323 1 controller.go:232] Started PV processing "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" I0828 02:57:38.044356 1 controller.go:239] PV "pvc-e959cc94-c357-43b7-a850-9a0a25d8582d" deleted, ignoring I0828 02:57:39.050918 1 controller.go:232] Started PV processing "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" I0828 02:57:39.050933 1 csi_handler.go:591] CSIHandler: processing PV "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" I0828 02:57:39.050953 1 csi_handler.go:633] CSIHandler: processing PV "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2": no VA found, removing finalizer E0828 02:57:39.055237 1 csi_handler.go:650] Failed to remove finalizer from PV "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2": PersistentVolume "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{"kubernetes.io/pv-protection"} I0828 02:57:39.055327 1 controller.go:232] Started PV processing "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" I0828 02:57:39.055365 1 csi_handler.go:591] CSIHandler: processing PV "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" I0828 02:57:39.055379 1 csi_handler.go:633] CSIHandler: processing PV "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2": no VA found, removing finalizer I0828 02:57:39.061249 1 csi_handler.go:655] Removed finalizer from PV "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" I0828 02:57:40.055472 1 controller.go:232] Started PV processing "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" I0828 02:57:40.055520 1 controller.go:239] PV "pvc-21573098-1e38-4fe5-8a38-3836e1746ce2" deleted, ignoring I0828 02:57:41.062465 1 controller.go:232] Started PV processing "pvc-29b56385-9192-453e-abfe-074938d79316" I0828 02:57:41.062481 1 csi_handler.go:591] CSIHandler: processing PV "pvc-29b56385-9192-453e-abfe-074938d79316" I0828 02:57:41.062493 1 csi_handler.go:633] CSIHandler: processing PV "pvc-29b56385-9192-453e-abfe-074938d79316": no VA found, removing finalizer E0828 02:57:41.067001 1 csi_handler.go:650] Failed to remove finalizer from PV "pvc-29b56385-9192-453e-abfe-074938d79316": PersistentVolume "pvc-29b56385-9192-453e-abfe-074938d79316" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{"kubernetes.io/pv-protection"} I0828 02:57:41.067032 1 controller.go:232] Started PV processing "pvc-29b56385-9192-453e-abfe-074938d79316" I0828 02:57:41.067040 1 csi_handler.go:591] CSIHandler: processing PV "pvc-29b56385-9192-453e-abfe-074938d79316" I0828 02:57:41.067052 1 csi_handler.go:633] CSIHandler: processing PV "pvc-29b56385-9192-453e-abfe-074938d79316": no VA found, removing finalizer I0828 02:57:41.072595 1 csi_handler.go:655] Removed finalizer from PV "pvc-29b56385-9192-453e-abfe-074938d79316" I0828 02:57:42.067208 1 controller.go:232] Started PV processing "pvc-29b56385-9192-453e-abfe-074938d79316" I0828 02:57:42.067227 1 controller.go:239] PV "pvc-29b56385-9192-453e-abfe-074938d79316" deleted, ignoring ==== end of pod log for container csi-mockplugin-attacher-0/csi-attacher ====