==== start of pod log for container csi-mockplugin-0/csi-provisioner ==== W1013 14:40:52.543640 1 feature_gate.go:235] Setting GA feature gate Topology=true. It will be removed in a future release. I1013 14:40:52.543693 1 feature_gate.go:243] feature gates: &{map[Topology:true]} I1013 14:40:52.543715 1 csi-provisioner.go:138] Version: v2.2.0 I1013 14:40:52.543742 1 csi-provisioner.go:161] Building kube configs for running in cluster... I1013 14:40:52.557791 1 connection.go:153] Connecting to unix:///csi/csi.sock I1013 14:40:55.293949 1 common.go:111] Probing CSI driver for readiness I1013 14:40:55.294003 1 connection.go:182] GRPC call: /csi.v1.Identity/Probe I1013 14:40:55.294016 1 connection.go:183] GRPC request: {} I1013 14:40:55.303120 1 connection.go:185] GRPC response: {"ready":{"value":true}} I1013 14:40:55.303350 1 connection.go:186] GRPC error: I1013 14:40:55.303370 1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginInfo I1013 14:40:55.303378 1 connection.go:183] GRPC request: {} I1013 14:40:55.305456 1 connection.go:185] GRPC response: {"manifest":{"url":"https://k8s.io/kubernetes/test/e2e/storage/drivers/csi-test/mock"},"name":"csi-mock-csi-mock-volumes-5049","vendor_version":"0.3.0"} I1013 14:40:55.305587 1 connection.go:186] GRPC error: I1013 14:40:55.305611 1 csi-provisioner.go:212] Detected CSI driver csi-mock-csi-mock-volumes-5049 I1013 14:40:55.305631 1 connection.go:182] GRPC call: /csi.v1.Identity/GetPluginCapabilities I1013 14:40:55.305639 1 connection.go:183] GRPC request: {} I1013 14:40:55.308507 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I1013 14:40:55.308838 1 connection.go:186] GRPC error: I1013 14:40:55.308857 1 connection.go:182] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I1013 14:40:55.308865 1 connection.go:183] GRPC request: {} I1013 14:40:55.311265 1 connection.go:185] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":9}}}]} I1013 14:40:55.311467 1 connection.go:186] GRPC error: I1013 14:40:55.311553 1 csi-provisioner.go:281] CSI driver does not support PUBLISH_UNPUBLISH_VOLUME, not watching VolumeAttachments I1013 14:40:55.312245 1 controller.go:756] Using saving PVs to API server in background I1013 14:40:55.312606 1 reflector.go:219] Starting reflector *v1.Node (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I1013 14:40:55.312625 1 reflector.go:255] Listing and watching *v1.Node from k8s.io/client-go/informers/factory.go:134 I1013 14:40:55.312679 1 reflector.go:219] Starting reflector *v1.StorageClass (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I1013 14:40:55.312698 1 reflector.go:255] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:134 I1013 14:40:55.312840 1 reflector.go:219] Starting reflector *v1.CSINode (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I1013 14:40:55.312869 1 reflector.go:255] Listing and watching *v1.CSINode from k8s.io/client-go/informers/factory.go:134 I1013 14:40:55.312963 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from k8s.io/client-go/informers/factory.go:134 I1013 14:40:55.313019 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:134 I1013 14:40:55.413340 1 shared_informer.go:270] caches populated I1013 14:40:55.413371 1 shared_informer.go:270] caches populated I1013 14:40:55.413380 1 shared_informer.go:270] caches populated I1013 14:40:55.413388 1 shared_informer.go:270] caches populated I1013 14:40:55.413417 1 controller.go:835] Starting provisioner controller csi-mock-csi-mock-volumes-5049_csi-mockplugin-0_2711b3df-2bcf-483e-b900-4ff156c86195! I1013 14:40:55.413437 1 clone_controller.go:66] Starting CloningProtection controller I1013 14:40:55.413457 1 volume_store.go:97] Starting save volume queue I1013 14:40:55.413506 1 clone_controller.go:84] Started CloningProtection controller I1013 14:40:55.413682 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from pkg/controller/clone_controller.go:82 I1013 14:40:55.413700 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from pkg/controller/clone_controller.go:82 I1013 14:40:55.413906 1 reflector.go:219] Starting reflector *v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:869 I1013 14:40:55.413930 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:869 I1013 14:40:55.413936 1 reflector.go:219] Starting reflector *v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:872 I1013 14:40:55.413996 1 reflector.go:255] Listing and watching *v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:872 I1013 14:40:55.514342 1 shared_informer.go:270] caches populated I1013 14:40:55.514493 1 controller.go:884] Started provisioner controller csi-mock-csi-mock-volumes-5049_csi-mockplugin-0_2711b3df-2bcf-483e-b900-4ff156c86195! I1013 14:40:56.277925 1 controller.go:1332] provision "csi-mock-volumes-5049/pvc-vk8t9" class "csi-mock-volumes-5049-sc674ld": started I1013 14:40:56.278185 1 connection.go:182] GRPC call: /csi.v1.Controller/CreateVolume I1013 14:40:56.278259 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"csi-mock-volumes-5049", Name:"pvc-vk8t9", UID:"e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca", APIVersion:"v1", ResourceVersion:"3736", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "csi-mock-volumes-5049/pvc-vk8t9" I1013 14:40:56.278229 1 connection.go:183] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"io.kubernetes.storage.mock/node":"some-mock-node"}}],"requisite":[{"segments":{"io.kubernetes.storage.mock/node":"some-mock-node"}}]},"capacity_range":{"required_bytes":1073741824},"name":"pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}]} I1013 14:40:56.282676 1 connection.go:185] GRPC response: {} I1013 14:40:56.282806 1 connection.go:186] GRPC error: rpc error: code = ResourceExhausted desc = fake error I1013 14:40:56.282855 1 controller.go:753] CreateVolume failed, supports topology = true, node selected true => may reschedule = true => state = Reschedule: rpc error: code = ResourceExhausted desc = fake error I1013 14:40:56.283087 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"csi-mock-volumes-5049", Name:"pvc-vk8t9", UID:"e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca", APIVersion:"v1", ResourceVersion:"3736", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "csi-mock-volumes-5049-sc674ld": rpc error: code = ResourceExhausted desc = fake error I1013 14:40:56.293909 1 controller.go:1426] provision "csi-mock-volumes-5049/pvc-vk8t9" class "csi-mock-volumes-5049-sc674ld": volume rescheduled because: failed to provision volume with StorageClass "csi-mock-volumes-5049-sc674ld": rpc error: code = ResourceExhausted desc = fake error I1013 14:40:56.293960 1 controller.go:1095] Stop provisioning, removing PVC e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca from claims in progress I1013 14:40:58.552069 1 controller.go:1332] provision "csi-mock-volumes-5049/pvc-vk8t9" class "csi-mock-volumes-5049-sc674ld": started I1013 14:40:58.552226 1 connection.go:182] GRPC call: /csi.v1.Controller/CreateVolume I1013 14:40:58.552291 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"csi-mock-volumes-5049", Name:"pvc-vk8t9", UID:"e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca", APIVersion:"v1", ResourceVersion:"3831", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "csi-mock-volumes-5049/pvc-vk8t9" I1013 14:40:58.552239 1 connection.go:183] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"io.kubernetes.storage.mock/node":"some-mock-node"}}],"requisite":[{"segments":{"io.kubernetes.storage.mock/node":"some-mock-node"}}]},"capacity_range":{"required_bytes":1073741824},"name":"pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}]} I1013 14:40:58.555244 1 connection.go:185] GRPC response: {"volume":{"accessible_topology":[{"segments":{"io.kubernetes.storage.mock/node":"some-mock-node"}}],"capacity_bytes":1073741824,"volume_context":{"name":"pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca"},"volume_id":"4"}} I1013 14:40:58.555334 1 connection.go:186] GRPC error: I1013 14:40:58.555353 1 controller.go:763] create volume rep: {CapacityBytes:1073741824 VolumeId:4 VolumeContext:map[name:pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca] ContentSource: AccessibleTopology:[segments: ] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} I1013 14:40:58.555418 1 controller.go:839] successfully created PV pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca for PVC pvc-vk8t9 and csi volume name 4 I1013 14:40:58.555441 1 controller.go:855] successfully created PV {GCEPersistentDisk:nil AWSElasticBlockStore:nil HostPath:nil Glusterfs:nil NFS:nil RBD:nil ISCSI:nil Cinder:nil CephFS:nil FC:nil Flocker:nil FlexVolume:nil AzureFile:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil PortworxVolume:nil ScaleIO:nil Local:nil StorageOS:nil CSI:&CSIPersistentVolumeSource{Driver:csi-mock-csi-mock-volumes-5049,VolumeHandle:4,ReadOnly:false,FSType:ext4,VolumeAttributes:map[string]string{name: pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca,storage.kubernetes.io/csiProvisionerIdentity: 1665672055311-8081-csi-mock-csi-mock-volumes-5049,},ControllerPublishSecretRef:nil,NodeStageSecretRef:nil,NodePublishSecretRef:nil,ControllerExpandSecretRef:nil,}} I1013 14:40:58.555629 1 controller.go:1439] provision "csi-mock-volumes-5049/pvc-vk8t9" class "csi-mock-volumes-5049-sc674ld": volume "pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca" provisioned I1013 14:40:58.555656 1 controller.go:1456] provision "csi-mock-volumes-5049/pvc-vk8t9" class "csi-mock-volumes-5049-sc674ld": succeeded I1013 14:40:58.555666 1 volume_store.go:154] Saving volume pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca I1013 14:40:58.560842 1 volume_store.go:157] Volume pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca saved I1013 14:40:58.560953 1 controller.go:1093] Claim processing succeeded, removing PVC e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca from claims in progress I1013 14:40:58.561025 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"csi-mock-volumes-5049", Name:"pvc-vk8t9", UID:"e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca", APIVersion:"v1", ResourceVersion:"3831", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca I1013 14:40:58.561108 1 controller.go:1332] provision "csi-mock-volumes-5049/pvc-vk8t9" class "csi-mock-volumes-5049-sc674ld": started I1013 14:40:58.561179 1 controller.go:1341] provision "csi-mock-volumes-5049/pvc-vk8t9" class "csi-mock-volumes-5049-sc674ld": persistentvolume "pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca" already exists, skipping I1013 14:40:58.561214 1 controller.go:1095] Stop provisioning, removing PVC e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca from claims in progress I1013 14:41:06.319228 1 controller.go:1472] delete "pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca": started I1013 14:41:06.319321 1 connection.go:182] GRPC call: /csi.v1.Controller/DeleteVolume I1013 14:41:06.319333 1 connection.go:183] GRPC request: {"volume_id":"4"} I1013 14:41:06.321901 1 connection.go:185] GRPC response: {} I1013 14:41:06.322008 1 connection.go:186] GRPC error: I1013 14:41:06.322034 1 controller.go:1487] delete "pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca": volume deleted I1013 14:41:06.335616 1 controller.go:1537] delete "pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca": persistentvolume deleted I1013 14:41:06.335669 1 controller.go:1542] delete "pvc-e4521cd5-a3af-47ad-ad9d-c29ff7ff1aca": succeeded E1013 14:41:08.308434 1 connection.go:131] Lost connection to unix:///csi/csi.sock. F1013 14:41:08.308647 1 connection.go:87] Lost connection to CSI driver, exiting goroutine 128 [running]: k8s.io/klog/v2.stacks(0xc000202001, 0xc00070e000, 0x57, 0xda) /workspace/vendor/k8s.io/klog/v2/klog.go:1021 +0xb9 k8s.io/klog/v2.(*loggingT).output(0x29b27c0, 0xc000000003, 0x0, 0x0, 0xc00003a230, 0x21e7fe8, 0xd, 0x57, 0x0) /workspace/vendor/k8s.io/klog/v2/klog.go:970 +0x191 k8s.io/klog/v2.(*loggingT).printf(0x29b27c0, 0x3, 0x0, 0x0, 0x0, 0x0, 0x1bf1042, 0x26, 0x0, 0x0, ...) /workspace/vendor/k8s.io/klog/v2/klog.go:751 +0x191 k8s.io/klog/v2.Fatalf(...) /workspace/vendor/k8s.io/klog/v2/klog.go:1509 github.com/kubernetes-csi/csi-lib-utils/connection.ExitOnConnectionLoss.func1(0x29b27c0) /workspace/vendor/github.com/kubernetes-csi/csi-lib-utils/connection/connection.go:87 +0x1ec github.com/kubernetes-csi/csi-lib-utils/connection.connect.func1(0xc0010f6a68, 0x14, 0x4a8165774, 0x4a8165774, 0x1, 0x2, 0xc0010f6a68) /workspace/vendor/github.com/kubernetes-csi/csi-lib-utils/connection/connection.go:134 +0x2aa google.golang.org/grpc.WithDialer.func1(0x1e18fe0, 0xc00025d3e0, 0xc0010f6a68, 0x14, 0xd, 0xc0010f6a68, 0x14, 0xc0009426d0) /workspace/vendor/google.golang.org/grpc/dialoptions.go:398 +0x8e google.golang.org/grpc/internal/transport.dial(0x1e18fe0, 0xc00025d3e0, 0xc000840db0, 0xc000047660, 0xd, 0x1bcac98, 0x9, 0xc0002805d8, 0x0, 0x0, ...) /workspace/vendor/google.golang.org/grpc/internal/transport/http2_client.go:152 +0x1c9 google.golang.org/grpc/internal/transport.newHTTP2Client(0x1e18fe0, 0xc00025d3e0, 0x1e18f70, 0xc000826180, 0xc000047660, 0xd, 0x1bcac98, 0x9, 0xc0002805d8, 0x0, ...) /workspace/vendor/google.golang.org/grpc/internal/transport/http2_client.go:193 +0x16d google.golang.org/grpc/internal/transport.NewClientTransport(...) /workspace/vendor/google.golang.org/grpc/internal/transport/transport.go:579 google.golang.org/grpc.(*addrConn).createTransport(0xc0001b78c0, 0xc000047660, 0xd, 0x1bcac98, 0x9, 0xc0002805d8, 0x0, 0x0, 0x0, 0x1bd077f, ...) /workspace/vendor/google.golang.org/grpc/clientconn.go:1322 +0x40f google.golang.org/grpc.(*addrConn).tryAllAddrs(0xc0001b78c0, 0xc0008261c0, 0x1, 0x1, 0xc0ca26c61260a0e3, 0x85516eaf0, 0x29b24a0, 0x1e30b08, 0xc00042e000, 0x0, ...) /workspace/vendor/google.golang.org/grpc/clientconn.go:1252 +0x34d google.golang.org/grpc.(*addrConn).resetTransport(0xc0001b78c0) /workspace/vendor/google.golang.org/grpc/clientconn.go:1167 +0x26b created by google.golang.org/grpc.(*addrConn).connect /workspace/vendor/google.golang.org/grpc/clientconn.go:843 +0x12a goroutine 1 [select (no cases)]: sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1(0x1e18fa8, 0xc000046050) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:886 +0xcc5 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run(0xc00043af00, 0x1e18fa8, 0xc000046050) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:919 +0xfc main.main.func3(0x1e18fa8, 0xc000046050) /workspace/cmd/csi-provisioner/csi-provisioner.go:543 +0x21d main.main() /workspace/cmd/csi-provisioner/csi-provisioner.go:547 +0x2f42 goroutine 18 [chan receive]: k8s.io/klog/v2.(*loggingT).flushDaemon(0x29b27c0) /workspace/vendor/k8s.io/klog/v2/klog.go:1164 +0x8b created by k8s.io/klog/v2.init.0 /workspace/vendor/k8s.io/klog/v2/klog.go:418 +0xdf goroutine 145 [chan receive]: k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0002bef00) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:204 +0xac created by k8s.io/client-go/util/workqueue.newQueue /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:62 +0x154 goroutine 131 [IO wait]: internal/poll.runtime_pollWait(0x7f295211ae88, 0x72, 0xffffffffffffffff) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/netpoll.go:222 +0x55 internal/poll.(*pollDesc).wait(0xc000296c98, 0x72, 0x4f00, 0x4f70, 0xffffffffffffffff) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/internal/poll/fd_poll_runtime.go:87 +0x45 internal/poll.(*pollDesc).waitRead(...) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Read(0xc000296c80, 0xc000b9a000, 0x4f70, 0x4f70, 0x0, 0x0, 0x0) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/internal/poll/fd_unix.go:166 +0x1d5 net.(*netFD).Read(0xc000296c80, 0xc000b9a000, 0x4f70, 0x4f70, 0x4f6b, 0xc000b9a000, 0x5) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/net/fd_posix.go:55 +0x4f net.(*conn).Read(0xc00000e010, 0xc000b9a000, 0x4f70, 0x4f70, 0x0, 0x0, 0x0) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/net/net.go:183 +0x91 crypto/tls.(*atLeastReader).Read(0xc00069cc30, 0xc000b9a000, 0x4f70, 0x4f70, 0x4f6b, 0xc000600400, 0x0) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/crypto/tls/conn.go:776 +0x63 bytes.(*Buffer).ReadFrom(0xc000214278, 0x1ddf900, 0xc00069cc30, 0x40b725, 0x19981c0, 0x1b58820) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/bytes/buffer.go:204 +0xbe crypto/tls.(*Conn).readFromUntil(0xc000214000, 0x1de2600, 0xc00000e010, 0x5, 0xc00000e010, 0x400) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/crypto/tls/conn.go:798 +0xf3 crypto/tls.(*Conn).readRecordOrCCS(0xc000214000, 0x0, 0x0, 0x4) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/crypto/tls/conn.go:605 +0x115 crypto/tls.(*Conn).readRecord(...) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/crypto/tls/conn.go:573 crypto/tls.(*Conn).Read(0xc000214000, 0xc00027e000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/crypto/tls/conn.go:1276 +0x165 bufio.(*Reader).Read(0xc000883f80, 0xc0008b22d8, 0x9, 0x9, 0xc0001e9aa0, 0xc0004174e8, 0xc000797c68) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/bufio/bufio.go:227 +0x222 io.ReadAtLeast(0x1ddf760, 0xc000883f80, 0xc0008b22d8, 0x9, 0x9, 0x9, 0x0, 0x2b2cf28b29ef01, 0xc0004174d0) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/io/io.go:328 +0x87 io.ReadFull(...) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/io/io.go:347 golang.org/x/net/http2.readFrameHeader(0xc0008b22d8, 0x9, 0x9, 0x1ddf760, 0xc000883f80, 0x0, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/frame.go:237 +0x89 golang.org/x/net/http2.(*Framer).ReadFrame(0xc0008b22a0, 0xc0002cb0b0, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 golang.org/x/net/http2.(*clientConnReadLoop).run(0xc000797fa8, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/transport.go:1819 +0xd8 golang.org/x/net/http2.(*ClientConn).readLoop(0xc000580d80) /workspace/vendor/golang.org/x/net/http2/transport.go:1741 +0x6f created by golang.org/x/net/http2.(*Transport).newClientConn /workspace/vendor/golang.org/x/net/http2/transport.go:705 +0x6c5 goroutine 110 [select]: k8s.io/client-go/tools/cache.(*processorListener).pop(0xc0004fc100) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:742 +0x151 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000460b50, 0xc00028c840) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 127 [select]: google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000826240) /workspace/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xac created by google.golang.org/grpc.newCCBalancerWrapper /workspace/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 goroutine 146 [select]: k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0002bf080) /workspace/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x3df created by k8s.io/client-go/util/workqueue.newDelayingQueue /workspace/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 goroutine 147 [chan receive]: k8s.io/apimachinery/pkg/watch.(*Broadcaster).loop(0xc00041f740) /workspace/vendor/k8s.io/apimachinery/pkg/watch/mux.go:247 +0x66 created by k8s.io/apimachinery/pkg/watch.NewLongQueueBroadcaster /workspace/vendor/k8s.io/apimachinery/pkg/watch/mux.go:89 +0xf8 goroutine 148 [chan receive]: k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1(0x1deb708, 0xc00069ffb0, 0xc000700ac0) /workspace/vendor/k8s.io/client-go/tools/record/event.go:301 +0xaa created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher /workspace/vendor/k8s.io/client-go/tools/record/event.go:299 +0x6e goroutine 149 [chan receive]: k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1(0x1deb708, 0xc0007021b0, 0xc000702180) /workspace/vendor/k8s.io/client-go/tools/record/event.go:301 +0xaa created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher /workspace/vendor/k8s.io/client-go/tools/record/event.go:299 +0x6e goroutine 150 [chan receive]: k8s.io/apimachinery/pkg/watch.(*Broadcaster).loop(0xc00041f900) /workspace/vendor/k8s.io/apimachinery/pkg/watch/mux.go:247 +0x66 created by k8s.io/apimachinery/pkg/watch.NewLongQueueBroadcaster /workspace/vendor/k8s.io/apimachinery/pkg/watch/mux.go:89 +0xf8 goroutine 151 [chan receive]: k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1(0x1deb708, 0xc0007022a0, 0xc000700af0) /workspace/vendor/k8s.io/client-go/tools/record/event.go:301 +0xaa created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher /workspace/vendor/k8s.io/client-go/tools/record/event.go:299 +0x6e goroutine 152 [chan receive]: k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1(0x1deb708, 0xc000702450, 0xc000702420) /workspace/vendor/k8s.io/client-go/tools/record/event.go:301 +0xaa created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher /workspace/vendor/k8s.io/client-go/tools/record/event.go:299 +0x6e goroutine 153 [chan receive]: k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0002bf4a0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:204 +0xac created by k8s.io/client-go/util/workqueue.newQueue /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:62 +0x154 goroutine 154 [select]: k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0002bf5c0) /workspace/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x3df created by k8s.io/client-go/util/workqueue.newDelayingQueue /workspace/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 goroutine 155 [chan receive]: k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0002bf680) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:204 +0xac created by k8s.io/client-go/util/workqueue.newQueue /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:62 +0x154 goroutine 156 [select]: k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0002bf800) /workspace/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x3df created by k8s.io/client-go/util/workqueue.newDelayingQueue /workspace/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 goroutine 157 [chan receive]: k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0002bf980) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:204 +0xac created by k8s.io/client-go/util/workqueue.newQueue /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:62 +0x154 goroutine 158 [select]: k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0002bfb00) /workspace/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x3df created by k8s.io/client-go/util/workqueue.newDelayingQueue /workspace/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 goroutine 159 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc0002a6028, 0x9) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc0002a6018) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0002a6000, 0xc00079a090, 0x0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:530 +0x98 k8s.io/client-go/tools/cache.(*controller).processLoop(0xc000430000) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:183 +0x42 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000917e70) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000917e70, 0x1de1e80, 0xc00048e1e0, 0xc000490001, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000917e70, 0x3b9aca00, 0x0, 0xc000a81601, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*controller).Run(0xc000430000, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:154 +0x2e5 k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc000352280, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:410 +0x42a created by k8s.io/client-go/informers.(*sharedInformerFactory).Start /workspace/vendor/k8s.io/client-go/informers/factory.go:134 +0x191 goroutine 160 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc0002c0028, 0x17) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc0002c0018) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0002c0000, 0xc00028c010, 0x0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:530 +0x98 k8s.io/client-go/tools/cache.(*controller).processLoop(0xc0002c2000) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:183 +0x42 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00096fe70) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00096fe70, 0x1de1e80, 0xc00025e0c0, 0xc0001a0101, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00096fe70, 0x3b9aca00, 0x0, 0xc00042f801, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*controller).Run(0xc0002c2000, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:154 +0x2e5 k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc0003523c0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:410 +0x42a created by k8s.io/client-go/informers.(*sharedInformerFactory).Start /workspace/vendor/k8s.io/client-go/informers/factory.go:134 +0x191 goroutine 161 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00046aac8, 0x3) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00046aab8) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc00046aaa0, 0xc000496fc0, 0x0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:530 +0x98 k8s.io/client-go/tools/cache.(*controller).processLoop(0xc000310cf0) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:183 +0x42 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00088be70) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00088be70, 0x1de1e80, 0xc000880090, 0xc0002ae701, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00088be70, 0x3b9aca00, 0x0, 0xc000434701, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*controller).Run(0xc000310cf0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:154 +0x2e5 k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc000352500, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:410 +0x42a created by k8s.io/client-go/informers.(*sharedInformerFactory).Start /workspace/vendor/k8s.io/client-go/informers/factory.go:134 +0x191 goroutine 162 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc000352a28, 0x8) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc000352a18) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc000352a00, 0xc000701000, 0x0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:530 +0x98 k8s.io/client-go/tools/cache.(*controller).processLoop(0xc0004ccc60) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:183 +0x42 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000911e70) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000911e70, 0x1de1e80, 0xc000703230, 0xc000047901, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000911e70, 0x3b9aca00, 0x0, 0xc00099d501, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*controller).Run(0xc0004ccc60, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:154 +0x2e5 k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc000352640, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:410 +0x42a created by k8s.io/client-go/informers.(*sharedInformerFactory).Start /workspace/vendor/k8s.io/client-go/informers/factory.go:134 +0x191 goroutine 244 [chan receive]: k8s.io/client-go/tools/cache.(*processorListener).run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:772 +0x5d k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000b47760) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00088df60, 0x1de1e80, 0xc000c27530, 0x1932b01, 0xc000160b40) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b47760, 0x3b9aca00, 0x0, 0xc000b47701, 0xc000160b40) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*processorListener).run(0xc0006fc000) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:771 +0x95 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000460b50, 0xc0006e43d0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 219 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fb10, 0x15) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fb00) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf680, 0x0, 0x0, 0x44a700) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc00043af00, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:990 +0x3e sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:929 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3() /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:881 +0x5c k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000c23740) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c23740, 0x1de1e80, 0xc000c01e00, 0xc000b47f01, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c23740, 0x3b9aca00, 0x0, 0x1c8bb01, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000c23740, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:881 +0x3d6 goroutine 109 [chan receive]: k8s.io/client-go/tools/cache.(*processorListener).run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:772 +0x5d k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000179f60) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c37f60, 0x1de1e80, 0xc000703800, 0x1932b01, 0xc00035e060) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000179f60, 0x3b9aca00, 0x0, 0x1, 0xc00035e060) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*processorListener).run(0xc0004fc100) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:771 +0x95 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000460b50, 0xc00028c820) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 92 [select]: k8s.io/client-go/tools/cache.(*processorListener).pop(0xc0004fc100) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:742 +0x151 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000460b50, 0xc000198b80) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 177 [chan receive]: k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000460a80, 0xc000492060) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:628 +0x53 k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000490080, 0xc0004b40d8) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 166 [chan receive]: k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000460bd0, 0xc000924cc0) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:628 +0x53 k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0000478d0, 0xc0002bac18) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 167 [chan receive (nil chan)]: k8s.io/client-go/tools/cache.(*controller).Run.func1(0x0, 0xc0004ccc60) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:130 +0x34 created by k8s.io/client-go/tools/cache.(*controller).Run /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:129 +0xa5 goroutine 178 [chan receive (nil chan)]: k8s.io/client-go/tools/cache.(*controller).Run.func1(0x0, 0xc000430000) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:130 +0x34 created by k8s.io/client-go/tools/cache.(*controller).Run /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:129 +0xa5 goroutine 258 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc0004174e0, 0x7) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc0004174d0) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 golang.org/x/net/http2.(*pipe).Read(0xc0004174c8, 0xc0008f0001, 0x1dff, 0x1dff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/pipe.go:65 +0x97 golang.org/x/net/http2.transportResponseBody.Read(0xc0004174a0, 0xc0008f0001, 0x1dff, 0x1dff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/transport.go:2108 +0xaf encoding/json.(*Decoder).refill(0xc0008b82c0, 0xa, 0x9) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:165 +0xeb encoding/json.(*Decoder).readValue(0xc0008b82c0, 0x0, 0x0, 0x194bc60) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:140 +0x1ff encoding/json.(*Decoder).Decode(0xc0008b82c0, 0x197fcc0, 0xc00069cd80, 0x203000, 0x203000) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:63 +0x7c k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc00069e390, 0xc000d1e000, 0x2000, 0x2600, 0x40, 0x38, 0x1a0db40) /workspace/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x1a8 k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0001a45f0, 0x0, 0x1deb460, 0xc000826e80, 0x0, 0x0, 0x0, 0xc00064fe64, 0x2) /workspace/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x89 k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc000626000, 0xc00064fe60, 0x0, 0x1, 0x1, 0x1, 0x0) /workspace/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x6e k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0007aa0c0) /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xe5 created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0xea goroutine 194 [chan receive]: k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000460b60, 0xc00035e2a0) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:628 +0x53 k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0002ae700, 0xc00000d458) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 195 [chan receive (nil chan)]: k8s.io/client-go/tools/cache.(*controller).Run.func1(0x0, 0xc000310cf0) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:130 +0x34 created by k8s.io/client-go/tools/cache.(*controller).Run /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:129 +0xa5 goroutine 91 [chan receive]: k8s.io/client-go/tools/cache.(*processorListener).run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:772 +0x5d k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000b4af60) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000545f60, 0x1de1e80, 0xc00046c390, 0x1932b01, 0xc00053e000) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b4af60, 0x3b9aca00, 0x0, 0x1, 0xc00053e000) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*processorListener).run(0xc0004fc100) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:771 +0x95 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000460b50, 0xc000198af0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 210 [chan receive]: k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000460af0, 0xc0002c4000) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:628 +0x53 k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0001a0050, 0xc000286060) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 211 [chan receive (nil chan)]: k8s.io/client-go/tools/cache.(*controller).Run.func1(0x0, 0xc0002c2000) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:130 +0x34 created by k8s.io/client-go/tools/cache.(*controller).Run /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:129 +0xa5 goroutine 168 [select]: k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000356b60, 0xc0ca26bdd345ba67, 0xa707fa6e, 0x29b24a0, 0x1deb6e0, 0xc0007aa0c0, 0xc000f07b90, 0xc0004b6a80, 0x0, 0x0, ...) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x165 k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000356b60, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6f7 k8s.io/client-go/tools/cache.(*Reflector).Run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:221 +0x38 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000912ec8) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000f07ec8, 0x1de1e60, 0xc0004a05a0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000356b60, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:220 +0x1ed k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000047910, 0xc0002bac30) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 241 [select]: k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000356b60, 0x0, 0xc0002c42a0, 0xc0004b6a80) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x125 created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2ed goroutine 179 [select]: k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0008b2000, 0xc0ca26bdd32a42a3, 0xa6ec8343, 0x29b24a0, 0x1deb6e0, 0xc0001bf780, 0xc000f03b90, 0xc000798660, 0x0, 0x0, ...) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x165 k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0008b2000, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6f7 k8s.io/client-go/tools/cache.(*Reflector).Run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:221 +0x38 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000887ec8) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000f03ec8, 0x1de1e60, 0xc0002a0000, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0008b2000, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:220 +0x1ed k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0004900c0, 0xc0004b40f0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 93 [select]: k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0008b2000, 0x0, 0xc000492840, 0xc000798660) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x125 created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2ed goroutine 196 [select]: k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0004281c0, 0xc0ca26bdd3265a0e, 0xa6e89a41, 0x29b24a0, 0x1deb6e0, 0xc0001bf680, 0xc000c9fb90, 0xc000204f00, 0x0, 0x0, ...) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x165 k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0004281c0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6f7 k8s.io/client-go/tools/cache.(*Reflector).Run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:221 +0x38 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00088cec8) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c9fec8, 0x1de1e60, 0xc000250a50, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0004281c0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:220 +0x1ed k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0002ae740, 0xc00000d470) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 181 [select]: k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0004281c0, 0x0, 0xc000924060, 0xc000204f00) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x125 created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2ed goroutine 212 [select]: k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0002e0000, 0xc0ca26bdd3366c3c, 0xa6f8accf, 0x29b24a0, 0x1deb6e0, 0xc0008b1f80, 0xc00052db90, 0xc00025c7e0, 0x0, 0x0, ...) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x165 k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0002e0000, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6f7 k8s.io/client-go/tools/cache.(*Reflector).Run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:221 +0x38 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000970ec8) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00052dec8, 0x1de1e60, 0xc0002de000, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0002e0000, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:220 +0x1ed k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0001a0140, 0xc000286078) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 217 [select]: k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0002e0000, 0x0, 0xc000160960, 0xc00025c7e0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x125 created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2ed goroutine 182 [chan receive]: k8s.io/client-go/tools/cache.(*processorListener).run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:772 +0x5d k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000b46f60) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000544f60, 0x1de1e80, 0xc000923500, 0x1932b01, 0xc000924240) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b46f60, 0x3b9aca00, 0x0, 0x1, 0xc000924240) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*processorListener).run(0xc0004fc180) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:771 +0x95 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000461480, 0xc0008c2420) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 220 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fa10, 0xc00000002e) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fa00) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf4a0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextClaimWorkItem(0xc00043af00, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:935 +0x3e sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runClaimWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:924 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.2() /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:880 +0x5c k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000c23760) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c23760, 0x1de1e80, 0xc000c01da0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c23760, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000c23760, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:880 +0x4af goroutine 95 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc000241220, 0x2) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc000241210) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 golang.org/x/net/http2.(*pipe).Read(0xc000241208, 0xc000e07001, 0xdff, 0xdff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/pipe.go:65 +0x97 golang.org/x/net/http2.transportResponseBody.Read(0xc0002411e0, 0xc000e07001, 0xdff, 0xdff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/transport.go:2108 +0xaf encoding/json.(*Decoder).refill(0xc0004d3080, 0xa, 0x9) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:165 +0xeb encoding/json.(*Decoder).readValue(0xc0004d3080, 0x0, 0x0, 0x194bc60) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:140 +0x1ff encoding/json.(*Decoder).Decode(0xc0004d3080, 0x197fcc0, 0xc000550ab0, 0x203000, 0x203000) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:63 +0x7c k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0002bca20, 0xc00099b500, 0x800, 0xa80, 0x40, 0x38, 0x1a0db40) /workspace/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x1a8 k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc000250b90, 0x0, 0x1deb460, 0xc00072b4c0, 0x0, 0x0, 0x0, 0xc000029e64, 0x2) /workspace/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x89 k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc00055cb80, 0xc000029e60, 0x0, 0x1, 0x1, 0x1, 0x0) /workspace/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x6e k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0001bf680) /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xe5 created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0xea goroutine 245 [select]: k8s.io/client-go/tools/cache.(*processorListener).pop(0xc0006fc000) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:742 +0x151 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000460b50, 0xc0006e43e0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 225 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc0004d2ca0, 0x8) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc0004d2c90) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 golang.org/x/net/http2.(*pipe).Read(0xc0004d2c88, 0xc000f0e001, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/pipe.go:65 +0x97 golang.org/x/net/http2.transportResponseBody.Read(0xc0004d2c60, 0xc000f0e001, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/transport.go:2108 +0xaf encoding/json.(*Decoder).refill(0xc0004d3340, 0xa, 0x9) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:165 +0xeb encoding/json.(*Decoder).readValue(0xc0004d3340, 0x0, 0x0, 0x194bc60) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:140 +0x1ff encoding/json.(*Decoder).Decode(0xc0004d3340, 0x197fcc0, 0xc00069c750, 0x203000, 0x203000) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:63 +0x7c k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0002bcc30, 0xc0001cb400, 0x400, 0x400, 0x40, 0x38, 0x1a0db40) /workspace/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x1a8 k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc000250c30, 0x0, 0x1deb460, 0xc000826700, 0x0, 0x0, 0x0, 0xc000f17e64, 0x2) /workspace/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x89 k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc00055cba0, 0xc000f17e60, 0x0, 0x1, 0x1, 0x1, 0x0) /workspace/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x6e k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0001bf780) /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xe5 created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0xea goroutine 226 [chan receive (nil chan)]: github.com/kubernetes-csi/external-provisioner/pkg/controller.(*CloningProtectionController).Run(0xc00041fc80, 0x1e18fa8, 0xc000046050, 0x1) /workspace/pkg/controller/clone_controller.go:85 +0x476 created by main.main.func3 /workspace/cmd/csi-provisioner/csi-provisioner.go:541 +0x273 goroutine 243 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc000233e80, 0x17) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc000233e70) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 golang.org/x/net/http2.(*pipe).Read(0xc000233e68, 0xc000e06001, 0xdff, 0xdff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/pipe.go:65 +0x97 golang.org/x/net/http2.transportResponseBody.Read(0xc000233e40, 0xc000e06001, 0xdff, 0xdff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/transport.go:2108 +0xaf encoding/json.(*Decoder).refill(0xc000417760, 0xa, 0x9) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:165 +0xeb encoding/json.(*Decoder).readValue(0xc000417760, 0x0, 0x0, 0x194bc60) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:140 +0x1ff encoding/json.(*Decoder).Decode(0xc000417760, 0x197fcc0, 0xc000551de8, 0x203000, 0x203000) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:63 +0x7c k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0006f0210, 0xc0010ec000, 0x1000, 0x1300, 0x40, 0x38, 0x1a0db40) /workspace/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x1a8 k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0004a0780, 0x0, 0x1deb460, 0xc0008b0780, 0x0, 0x0, 0x0, 0xc000c9be64, 0x2) /workspace/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x89 k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc0006d3780, 0xc000c9be60, 0x0, 0x1, 0x1, 0x1, 0x0) /workspace/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x6e k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0008b1f80) /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xe5 created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0xea goroutine 227 [chan receive (nil chan)]: sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).Run(0xc000461500, 0x1e18fa8, 0xc000046050, 0x4) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:103 +0x1ce created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:889 +0xc5 goroutine 228 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc0002c03e8, 0x16) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc0002c03d8) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0002c03c0, 0xc000715f00, 0x0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:530 +0x98 k8s.io/client-go/tools/cache.(*controller).processLoop(0xc0002c2b40) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:183 +0x42 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000542e70) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000542e70, 0x1de1e80, 0xc0002bd050, 0xc0007a0d01, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000542e70, 0x3b9aca00, 0x0, 0xc00043b401, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*controller).Run(0xc0002c2b40, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:154 +0x2e5 k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc000352820, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:410 +0x42a created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:869 +0x6b5 goroutine 229 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00061e0c8, 0x9) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00061e0b8) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc00061e0a0, 0xc000d84250, 0x0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:530 +0x98 k8s.io/client-go/tools/cache.(*controller).processLoop(0xc0004cce10) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:183 +0x42 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000888e70) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000888e70, 0x1de1e80, 0xc00069e5a0, 0xc0007ac001, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000888e70, 0x3b9aca00, 0x0, 0xc000602701, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*controller).Run(0xc0004cce10, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:154 +0x2e5 k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc0003528c0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:410 +0x42a created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:872 +0x65e goroutine 232 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fc50, 0x1) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fc40) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf980, 0x0, 0x0, 0xc00071ee00) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).processNextWorkItem(0xc000461500, 0x203000) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:113 +0x6c sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).saveVolumeWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:108 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000715eb0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000715eb0, 0x1de1e80, 0xc000c27560, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000715eb0, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000715eb0, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).Run /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:101 +0x105 goroutine 260 [chan receive]: k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000461490, 0xc00053e120) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:628 +0x53 k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0007ac030, 0xc0006143d8) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 261 [chan receive (nil chan)]: k8s.io/client-go/tools/cache.(*controller).Run.func1(0x0, 0xc0004cce10) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:130 +0x34 created by k8s.io/client-go/tools/cache.(*controller).Run /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:129 +0xa5 goroutine 246 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041f710, 0xc000000004) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041f700) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bef00, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 github.com/kubernetes-csi/external-provisioner/pkg/controller.(*CloningProtectionController).processNextClaimWorkItem(0xc00041fc80, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/pkg/controller/clone_controller.go:96 +0x38 github.com/kubernetes-csi/external-provisioner/pkg/controller.(*CloningProtectionController).runClaimWorker(...) /workspace/pkg/controller/clone_controller.go:90 github.com/kubernetes-csi/external-provisioner/pkg/controller.(*CloningProtectionController).Run.func3() /workspace/pkg/controller/clone_controller.go:78 +0x5d k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0006d37e0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0006d37e0, 0x1de1e80, 0xc000c27590, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0006d37e0, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc0006d37e0, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by github.com/kubernetes-csi/external-provisioner/pkg/controller.(*CloningProtectionController).Run /workspace/pkg/controller/clone_controller.go:77 +0x2bb goroutine 247 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc0006f20c8, 0x17) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc0006f20b8) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0006f20a0, 0xc0006e4430, 0x0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:530 +0x98 k8s.io/client-go/tools/cache.(*controller).processLoop(0xc0008d2480) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:183 +0x42 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000547e70) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000547e70, 0x1de1e80, 0xc0006f02d0, 0xc0008d4c01, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000547e70, 0x3b9aca00, 0x0, 0xc00042f801, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*controller).Run(0xc0008d2480, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:154 +0x2e5 k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc0003523c0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:410 +0x42a created by github.com/kubernetes-csi/external-provisioner/pkg/controller.(*CloningProtectionController).Run /workspace/pkg/controller/clone_controller.go:82 +0x3d2 goroutine 218 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fa10, 0xc00000002a) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fa00) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf4a0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextClaimWorkItem(0xc00043af00, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:935 +0x3e sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runClaimWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:924 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.2() /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:880 +0x5c k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000c23720) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c23720, 0x1de1e80, 0xc000c01dd0, 0xc000c2f701, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c23720, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000c23720, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:880 +0x4af goroutine 249 [chan receive]: k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000460af0, 0xc0002c4600) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:628 +0x53 k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0008d4bf0, 0xc00069d410) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 250 [chan receive (nil chan)]: k8s.io/client-go/tools/cache.(*controller).Run.func1(0x0, 0xc0008d2480) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:130 +0x34 created by k8s.io/client-go/tools/cache.(*controller).Run /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:129 +0xa5 goroutine 233 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fc50, 0xc000000003) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fc40) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf980, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).processNextWorkItem(0xc000461500, 0x203000) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:113 +0x6c sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).saveVolumeWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:108 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000715ec0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000715ec0, 0x1de1e80, 0xc0002bccc0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000715ec0, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000715ec0, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).Run /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:101 +0x105 goroutine 234 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fc50, 0xc000000002) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fc40) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf980, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).processNextWorkItem(0xc000461500, 0x203000) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:113 +0x6c sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).saveVolumeWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:108 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000715ed0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000715ed0, 0x1de1e80, 0xc0002bcff0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000715ed0, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000715ed0, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).Run /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:101 +0x105 goroutine 235 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fc50, 0x0) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fc40) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf980, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).processNextWorkItem(0xc000461500, 0x203000) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:113 +0x6c sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).saveVolumeWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:108 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000715ee0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000715ee0, 0x1de1e80, 0xc0002bcc90, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000715ee0, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000715ee0, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*queueStore).Run /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/volume_store.go:101 +0x105 goroutine 237 [chan receive]: k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000461420, 0xc000492e40) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:628 +0x53 k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0007a0da0, 0xc000286a68) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 238 [chan receive (nil chan)]: k8s.io/client-go/tools/cache.(*controller).Run.func1(0x0, 0xc0002c2b40) /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:130 +0x34 created by k8s.io/client-go/tools/cache.(*controller).Run /workspace/vendor/k8s.io/client-go/tools/cache/controller.go:129 +0xa5 goroutine 111 [chan receive]: k8s.io/client-go/tools/cache.(*processorListener).run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:772 +0x5d k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00056c760) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00088cf60, 0x1de1e80, 0xc000923530, 0x1932b01, 0xc0009242a0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00056c760, 0x3b9aca00, 0x0, 0x1, 0xc0009242a0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(...) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 k8s.io/client-go/tools/cache.(*processorListener).run(0xc0006fc000) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:771 +0x95 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000460b50, 0xc00028c860) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 112 [select]: k8s.io/client-go/tools/cache.(*processorListener).pop(0xc0006fc000) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:742 +0x151 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000460b50, 0xc00028c880) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 251 [select]: k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0008b2540, 0xc0ca26bdd8d78139, 0xac99c129, 0x29b24a0, 0x1deb6e0, 0xc000826480, 0xc0006edb90, 0xc000798ea0, 0x0, 0x0, ...) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x165 k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0008b2540, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6f7 k8s.io/client-go/tools/cache.(*Reflector).Run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:221 +0x38 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000974ec8) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0006edec8, 0x1de1e60, 0xc0004a07d0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0008b2540, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:220 +0x1ed k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0008d4c30, 0xc00069d428) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 183 [select]: k8s.io/client-go/tools/cache.(*processorListener).pop(0xc0004fc180) /workspace/vendor/k8s.io/client-go/tools/cache/shared_informer.go:742 +0x151 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000461480, 0xc0008c2430) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 273 [select]: k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0008b2540, 0x0, 0xc0004932c0, 0xc000798ea0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x125 created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2ed goroutine 239 [select]: k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000356700, 0xc0ca26bdd92590cd, 0xace7d0db, 0x29b24a0, 0x1deb6e0, 0xc00047ba00, 0xc000e35b90, 0xc00041c5a0, 0x0, 0x0, ...) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x165 k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000356700, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6f7 k8s.io/client-go/tools/cache.(*Reflector).Run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:221 +0x38 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000543ec8) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000e35ec8, 0x1de1e60, 0xc000250d20, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000356700, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:220 +0x1ed k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0007a0de0, 0xc000286a80) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 262 [select]: k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0002e00e0, 0xc0ca26bdd8d7d1bb, 0xac9a12ff, 0x29b24a0, 0x1deb6e0, 0xc0001bfe40, 0xc000e31b90, 0xc0004b6f00, 0x0, 0x0, ...) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x165 k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0002e00e0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6f7 k8s.io/client-go/tools/cache.(*Reflector).Run.func1() /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:221 +0x38 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00088dec8) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000e31ec8, 0x1de1e60, 0xc0001a4690, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0002e00e0, 0x0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:220 +0x1ed k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1() /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:56 +0x2e k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0007ac070, 0xc0006143f0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 goroutine 184 [select]: k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000356700, 0x0, 0xc000924f00, 0xc00041c5a0) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x125 created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2ed goroutine 253 [select]: k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0002e00e0, 0x0, 0xc0002c4780, 0xc0004b6f00) /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x125 created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch /workspace/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2ed goroutine 276 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00016f220, 0x8) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00016f210) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 golang.org/x/net/http2.(*pipe).Read(0xc00016f208, 0xc0008e8c01, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/pipe.go:65 +0x97 golang.org/x/net/http2.transportResponseBody.Read(0xc00016f1e0, 0xc0008e8c01, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/transport.go:2108 +0xaf encoding/json.(*Decoder).refill(0xc00016f600, 0xa, 0x9) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:165 +0xeb encoding/json.(*Decoder).readValue(0xc00016f600, 0x0, 0x0, 0x194bc60) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:140 +0x1ff encoding/json.(*Decoder).Decode(0xc00016f600, 0x197fcc0, 0xc000551b00, 0x203000, 0x203000) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:63 +0x7c k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc000808150, 0xc00080a000, 0x400, 0x400, 0x40, 0x38, 0x1a0db40) /workspace/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x1a8 k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc000250ff0, 0x0, 0x1deb460, 0xc0008b0300, 0x0, 0x0, 0x0, 0xc000025e64, 0x2) /workspace/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x89 k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc00055d0c0, 0xc000025e60, 0x0, 0x1, 0x1, 0x1, 0x0) /workspace/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x6e k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0001bfe40) /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xe5 created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0xea goroutine 254 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00016f0c0, 0x17) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00016f0b0) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 golang.org/x/net/http2.(*pipe).Read(0xc00016f0a8, 0xc000c54001, 0xdff, 0xdff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/pipe.go:65 +0x97 golang.org/x/net/http2.transportResponseBody.Read(0xc00016f080, 0xc000c54001, 0xdff, 0xdff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/transport.go:2108 +0xaf encoding/json.(*Decoder).refill(0xc0008a6580, 0xa, 0x9) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:165 +0xeb encoding/json.(*Decoder).readValue(0xc0008a6580, 0x0, 0x0, 0x194bc60) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:140 +0x1ff encoding/json.(*Decoder).Decode(0xc0008a6580, 0x197fcc0, 0xc00069cbd0, 0x203000, 0x203000) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:63 +0x7c k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0006f0840, 0xc0008f2000, 0x1000, 0x1300, 0x40, 0x38, 0x1a0db40) /workspace/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x1a8 k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0004a0d20, 0x0, 0x1deb460, 0xc000826ac0, 0x0, 0x0, 0x0, 0xc0006e7e64, 0x2) /workspace/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x89 k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc0006d3de0, 0xc0006e7e60, 0x0, 0x1, 0x1, 0x1, 0x0) /workspace/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x6e k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc000826480) /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xe5 created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0xea goroutine 186 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc000c8a300, 0x15) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc000c8a2f0) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 golang.org/x/net/http2.(*pipe).Read(0xc000c8a2e8, 0xc000419001, 0xdff, 0xdff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/pipe.go:65 +0x97 golang.org/x/net/http2.transportResponseBody.Read(0xc000c8a2c0, 0xc000419001, 0xdff, 0xdff, 0x0, 0x0, 0x0) /workspace/vendor/golang.org/x/net/http2/transport.go:2108 +0xaf encoding/json.(*Decoder).refill(0xc000c8a580, 0xa, 0x9) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:165 +0xeb encoding/json.(*Decoder).readValue(0xc000c8a580, 0x0, 0x0, 0x194bc60) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:140 +0x1ff encoding/json.(*Decoder).Decode(0xc000c8a580, 0x197fcc0, 0xc00069c9f0, 0x203000, 0x203000) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/encoding/json/stream.go:63 +0x7c k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc000c01d40, 0xc0005b4600, 0x1000, 0x1300, 0x40, 0x38, 0x1a0db40) /workspace/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x1a8 k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0002deb90, 0x0, 0x1deb460, 0xc000826900, 0x0, 0x0, 0x0, 0xc0006e9e64, 0x2) /workspace/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x89 k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc000c0f220, 0xc0006e9e60, 0x0, 0x1, 0x1, 0x1, 0x0) /workspace/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x6e k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc00047ba00) /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xe5 created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher /workspace/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0xea goroutine 221 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fb10, 0x12) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fb00) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf680, 0x0, 0x0, 0xc000c2e500) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc00043af00, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:990 +0x3e sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:929 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3() /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:881 +0x5c k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000c23780) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c23780, 0x1de1e80, 0xc000c275f0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c23780, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000c23780, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:881 +0x3d6 goroutine 222 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fa10, 0xc00000002c) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fa00) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf4a0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextClaimWorkItem(0xc00043af00, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:935 +0x3e sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runClaimWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:924 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.2() /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:880 +0x5c k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000c237a0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c237a0, 0x1de1e80, 0xc000c01fb0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c237a0, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000c237a0, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:880 +0x4af goroutine 223 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fb10, 0x13) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fb00) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf680, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc00043af00, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:990 +0x3e sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:929 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3() /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:881 +0x5c k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000c237c0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c237c0, 0x1de1e80, 0xc0006f0990, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c237c0, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000c237c0, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:881 +0x3d6 goroutine 224 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fa10, 0xc00000002d) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fa00) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf4a0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextClaimWorkItem(0xc00043af00, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:935 +0x3e sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runClaimWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:924 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.2() /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:880 +0x5c k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000c237e0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c237e0, 0x1de1e80, 0xc000808210, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c237e0, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000c237e0, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:880 +0x4af goroutine 289 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fb10, 0x14) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fb00) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf680, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc00043af00, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:990 +0x3e sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:929 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3() /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:881 +0x5c k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000c23800) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c23800, 0x1de1e80, 0xc000c276e0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c23800, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000c23800, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:881 +0x3d6 goroutine 290 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fa10, 0xc00000002b) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fa00) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf4a0, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextClaimWorkItem(0xc00043af00, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:935 +0x3e sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runClaimWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:924 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.2() /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:880 +0x5c k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000c23820) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c23820, 0x1de1e80, 0xc000c27710, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c23820, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000c23820, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:880 +0x4af goroutine 291 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc00041fb10, 0x16) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/runtime/sema.go:513 +0xf8 sync.(*Cond).Wait(0xc00041fb00) /go/pkg/csiprow.XXXXFMKBJL/go-1.16/src/sync/cond.go:56 +0x99 k8s.io/client-go/util/workqueue.(*Type).Get(0xc0002bf680, 0x0, 0x0, 0x0) /workspace/vendor/k8s.io/client-go/util/workqueue/queue.go:151 +0x89 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc00043af00, 0x1e18fa8, 0xc000046050, 0x203001) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:990 +0x3e sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...) /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:929 sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3() /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:881 +0x5c k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000c23840) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000c23840, 0x1de1e80, 0xc000c275c0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0x9b k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000c23840, 0x3b9aca00, 0x0, 0x1, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 k8s.io/apimachinery/pkg/util/wait.Until(0xc000c23840, 0x3b9aca00, 0x0) /workspace/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1 /workspace/vendor/sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller/controller.go:881 +0x3d6 ==== end of pod log for container csi-mockplugin-0/csi-provisioner ==== ==== start of pod log for container csi-mockplugin-0/csi-provisioner ==== W1013 14:41:09.413596 1 feature_gate.go:235] Setting GA feature gate Topology=true. It will be removed in a future release. I1013 14:41:09.413662 1 feature_gate.go:243] feature gates: &{map[Topology:true]} I1013 14:41:09.413682 1 csi-provisioner.go:138] Version: v2.2.0 I1013 14:41:09.413709 1 csi-provisioner.go:161] Building kube configs for running in cluster... I1013 14:41:09.428732 1 connection.go:153] Connecting to unix:///csi/csi.sock I1013 14:41:09.429333 1 common.go:111] Probing CSI driver for readiness I1013 14:41:09.429353 1 connection.go:182] GRPC call: /csi.v1.Identity/Probe I1013 14:41:09.429360 1 connection.go:183] GRPC request: {} E1013 14:41:09.433626 1 connection.go:131] Lost connection to unix:///csi/csi.sock. I1013 14:41:09.433679 1 connection.go:185] GRPC response: {} I1013 14:41:09.433759 1 connection.go:186] GRPC error: rpc error: code = Unavailable desc = transport is closing E1013 14:41:09.433795 1 csi-provisioner.go:203] CSI driver probe failed: rpc error: code = Unavailable desc = transport is closing F1013 14:41:09.433823 1 connection.go:87] Lost connection to CSI driver, exiting ==== end of pod log for container csi-mockplugin-0/csi-provisioner ====