==== start of pod log for container csi-mockplugin-0/csi-provisioner ==== W0505 01:13:18.794477 1 feature_gate.go:237] Setting GA feature gate Topology=true. It will be removed in a future release. I0505 01:13:18.794568 1 feature_gate.go:245] feature gates: &{map[Topology:true]} I0505 01:13:18.794591 1 csi-provisioner.go:138] Version: v3.0.0 I0505 01:13:18.794618 1 csi-provisioner.go:161] Building kube configs for running in cluster... I0505 01:13:18.796643 1 connection.go:154] Connecting to unix:///csi/csi.sock I0505 01:13:19.798242 1 common.go:111] Probing CSI driver for readiness I0505 01:13:19.798289 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0505 01:13:19.798299 1 connection.go:184] GRPC request: {} I0505 01:13:19.810269 1 connection.go:186] GRPC response: {} I0505 01:13:19.810443 1 connection.go:187] GRPC error: I0505 01:13:19.810462 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0505 01:13:19.810471 1 connection.go:184] GRPC request: {} I0505 01:13:19.811504 1 connection.go:186] GRPC response: {"name":"csi-mock-csi-mock-volumes-7178","vendor_version":"v1.7.3"} I0505 01:13:19.811610 1 connection.go:187] GRPC error: I0505 01:13:19.811630 1 csi-provisioner.go:205] Detected CSI driver csi-mock-csi-mock-volumes-7178 I0505 01:13:19.811646 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0505 01:13:19.811654 1 connection.go:184] GRPC request: {} I0505 01:13:19.812983 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0505 01:13:19.813218 1 connection.go:187] GRPC error: I0505 01:13:19.813237 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0505 01:13:19.813248 1 connection.go:184] GRPC request: {} I0505 01:13:19.814921 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":2}}}]} I0505 01:13:19.815431 1 connection.go:187] GRPC error: I0505 01:13:19.815557 1 csi-provisioner.go:274] CSI driver supports PUBLISH_UNPUBLISH_VOLUME, watching VolumeAttachments I0505 01:13:19.816947 1 controller.go:731] Using saving PVs to API server in background I0505 01:13:19.817415 1 reflector.go:219] Starting reflector *v1.CSINode (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.817439 1 reflector.go:255] Listing and watching *v1.CSINode from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.817503 1 reflector.go:219] Starting reflector *v1.StorageClass (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.817519 1 reflector.go:255] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.817532 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.817561 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.817562 1 reflector.go:219] Starting reflector *v1.VolumeAttachment (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.817602 1 reflector.go:255] Listing and watching *v1.VolumeAttachment from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.817635 1 reflector.go:219] Starting reflector *v1.Node (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.817653 1 reflector.go:255] Listing and watching *v1.Node from k8s.io/client-go/informers/factory.go:134 I0505 01:13:19.917959 1 shared_informer.go:270] caches populated I0505 01:13:19.918039 1 shared_informer.go:270] caches populated I0505 01:13:19.918056 1 shared_informer.go:270] caches populated I0505 01:13:19.918068 1 shared_informer.go:270] caches populated I0505 01:13:19.918081 1 shared_informer.go:270] caches populated I0505 01:13:19.918106 1 controller.go:810] Starting provisioner controller csi-mock-csi-mock-volumes-7178_csi-mockplugin-0_89cc5889-cfa4-480c-acca-3af7ed79de62! I0505 01:13:19.918135 1 clone_controller.go:66] Starting CloningProtection controller I0505 01:13:19.918163 1 volume_store.go:97] Starting save volume queue I0505 01:13:19.918188 1 clone_controller.go:82] Started CloningProtection controller I0505 01:13:19.918384 1 reflector.go:219] Starting reflector *v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v7/controller/controller.go:847 I0505 01:13:19.918413 1 reflector.go:255] Listing and watching *v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/v7/controller/controller.go:847 I0505 01:13:19.918393 1 reflector.go:219] Starting reflector *v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v7/controller/controller.go:844 I0505 01:13:19.918493 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/v7/controller/controller.go:844 I0505 01:13:20.018304 1 shared_informer.go:270] caches populated I0505 01:13:20.018413 1 controller.go:859] Started provisioner controller csi-mock-csi-mock-volumes-7178_csi-mockplugin-0_89cc5889-cfa4-480c-acca-3af7ed79de62! E0505 01:13:20.018437 1 controller.go:1025] claim "a8d3ed17-6ac7-4ac9-9209-ba8542ff0d8c" in work queue no longer exists I0505 01:13:22.971872 1 controller.go:1279] provision "csi-mock-volumes-7178/pvc-jhj46" class "csi-mock-volumes-7178-scwtnld": started I0505 01:13:22.972179 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"csi-mock-volumes-7178", Name:"pvc-jhj46", UID:"7ea5e988-ca2f-4026-b031-9e557c4e7c73", APIVersion:"v1", ResourceVersion:"5088226", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "csi-mock-volumes-7178/pvc-jhj46" I0505 01:13:22.972303 1 connection.go:183] GRPC call: /csi.v1.Controller/CreateVolume I0505 01:13:22.972321 1 connection.go:184] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"topology.hostpath.csi/node":"v125-worker2"}},{"segments":{"topology.hostpath.csi/node":"v125-worker"}}],"requisite":[{"segments":{"topology.hostpath.csi/node":"v125-worker2"}},{"segments":{"topology.hostpath.csi/node":"v125-worker"}}]},"capacity_range":{"required_bytes":1073741824},"name":"pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}]} I0505 01:13:22.979827 1 connection.go:186] GRPC response: {"volume":{"accessible_topology":[{"segments":{"topology.hostpath.csi/node":"v125-worker"}}],"capacity_bytes":1073741824,"volume_id":"079f7f33-eae2-11ed-b0b7-8a7523753b2e"}} I0505 01:13:22.980009 1 connection.go:187] GRPC error: I0505 01:13:22.980080 1 controller.go:777] create volume rep: {CapacityBytes:1073741824 VolumeId:079f7f33-eae2-11ed-b0b7-8a7523753b2e VolumeContext:map[] ContentSource: AccessibleTopology:[segments: ] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} I0505 01:13:22.980170 1 controller.go:861] successfully created PV pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73 for PVC pvc-jhj46 and csi volume name 079f7f33-eae2-11ed-b0b7-8a7523753b2e I0505 01:13:22.980198 1 controller.go:877] successfully created PV {GCEPersistentDisk:nil AWSElasticBlockStore:nil HostPath:nil Glusterfs:nil NFS:nil RBD:nil ISCSI:nil Cinder:nil CephFS:nil FC:nil Flocker:nil FlexVolume:nil AzureFile:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil PortworxVolume:nil ScaleIO:nil Local:nil StorageOS:nil CSI:&CSIPersistentVolumeSource{Driver:csi-mock-csi-mock-volumes-7178,VolumeHandle:079f7f33-eae2-11ed-b0b7-8a7523753b2e,ReadOnly:false,FSType:ext4,VolumeAttributes:map[string]string{storage.kubernetes.io/csiProvisionerIdentity: 1683249199815-8081-csi-mock-csi-mock-volumes-7178,},ControllerPublishSecretRef:nil,NodeStageSecretRef:nil,NodePublishSecretRef:nil,ControllerExpandSecretRef:nil,}} I0505 01:13:22.980432 1 controller.go:1384] provision "csi-mock-volumes-7178/pvc-jhj46" class "csi-mock-volumes-7178-scwtnld": volume "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73" provisioned I0505 01:13:22.980456 1 controller.go:1397] provision "csi-mock-volumes-7178/pvc-jhj46" class "csi-mock-volumes-7178-scwtnld": succeeded I0505 01:13:22.980470 1 volume_store.go:154] Saving volume pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73 I0505 01:13:22.986927 1 volume_store.go:157] Volume pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73 saved I0505 01:13:22.987041 1 controller.go:1068] Claim processing succeeded, removing PVC 7ea5e988-ca2f-4026-b031-9e557c4e7c73 from claims in progress I0505 01:13:22.987118 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"csi-mock-volumes-7178", Name:"pvc-jhj46", UID:"7ea5e988-ca2f-4026-b031-9e557c4e7c73", APIVersion:"v1", ResourceVersion:"5088226", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73 I0505 01:13:44.065433 1 controller.go:1413] delete "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": started E0505 01:13:44.065535 1 controller.go:1423] delete "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": volume deletion failed: persistentvolume pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73 is still attached to node v125-worker W0505 01:13:44.065622 1 controller.go:988] Retrying syncing volume "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73", failure 0 E0505 01:13:44.065656 1 controller.go:1006] error syncing volume "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": persistentvolume pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73 is still attached to node v125-worker I0505 01:13:44.065714 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73", UID:"5992869c-758e-45e0-bf45-1d2b576e1bcd", APIVersion:"v1", ResourceVersion:"5088770", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' persistentvolume pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73 is still attached to node v125-worker I0505 01:13:45.066916 1 controller.go:1413] delete "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": started I0505 01:13:45.067081 1 connection.go:183] GRPC call: /csi.v1.Controller/DeleteVolume I0505 01:13:45.067107 1 connection.go:184] GRPC request: {"volume_id":"079f7f33-eae2-11ed-b0b7-8a7523753b2e"} I0505 01:13:45.069618 1 connection.go:186] GRPC response: {} I0505 01:13:45.069719 1 connection.go:187] GRPC error: I0505 01:13:45.069737 1 controller.go:1428] delete "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": volume deleted I0505 01:13:45.075207 1 controller.go:1478] delete "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": persistentvolume deleted I0505 01:13:45.075248 1 controller.go:1483] delete "pvc-7ea5e988-ca2f-4026-b031-9e557c4e7c73": succeeded ==== end of pod log for container csi-mockplugin-0/csi-provisioner ====